Jun 29 10:56:27 devstack cinder-volume[82425]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 29 10:56:27 devstack cinder-volume[82425]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 29 10:56:27 devstack cinder-volume[82425]: we strongly recommend against using it for new projects. Jun 29 10:56:27 devstack cinder-volume[82425]: If you are already using Eventlet, we recommend migrating to a different Jun 29 10:56:27 devstack cinder-volume[82425]: framework. For more detail see Jun 29 10:56:27 devstack cinder-volume[82425]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 29 10:56:27 devstack cinder-volume[82425]: import eventlet # noqa Jun 29 10:56:30 devstack cinder-volume[82425]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82425) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 29 10:56:30 devstack cinder-volume[82425]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82425) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 29 10:56:30 devstack cinder-volume[82425]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82425) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 29 10:56:31 devstack cinder-volume[82425]: INFO dbcounter [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Registered counter for database cinder Jun 29 10:56:31 devstack cinder-volume[82425]: DEBUG oslo_db.sqlalchemy.engines [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82425) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 10:56:31 devstack cinder-volume[82425]: DEBUG dbcounter [-] [82425] Writer thread running {{(pid=82425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 29 10:56:31 devstack cinder-volume[82425]: INFO cinder.rpc [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 29 10:56:31 devstack cinder-volume[82425]: INFO cinder.rpc [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 29 10:56:31 devstack cinder-volume[82425]: DEBUG oslo_db.sqlalchemy.engines [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82425) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 10:56:31 devstack cinder-volume[82425]: INFO cinder.volume.manager [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Determined volume DB was empty at startup. Jun 29 10:56:31 devstack cinder-volume[82425]: DEBUG cinder.volume.manager [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82425) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 29 10:56:32 devstack cinder-volume[82425]: INFO cinder.volume.manager [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 29 10:56:32 devstack cinder-volume[82425]: WARNING stevedore.named [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 29 10:56:32 devstack cinder-volume[82425]: WARNING castellan.key_manager [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 29 10:56:32 devstack cinder-volume[82425]: WARNING cinder.keymgr.conf_key_mgr [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 29 10:56:32 devstack cinder-volume[82425]: DEBUG cinder.volume.drivers.lvm [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82425) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 29 10:56:32 devstack cinder-volume[82425]: DEBUG oslo_concurrency.processutils [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:32 devstack cinder-volume[82425]: DEBUG oslo_concurrency.processutils [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] CMD "cinder-rtstool verify" returned: 0 in 0.931s {{(pid=82425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_db.sqlalchemy.engines [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82425) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 10:56:33 devstack cinder-volume[82425]: INFO cinder.rpc [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 29 10:56:33 devstack cinder-volume[82425]: INFO cinder.rpc [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 29 10:56:33 devstack cinder-volume[82425]: WARNING stevedore.named [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 29 10:56:33 devstack cinder-volume[82425]: WARNING castellan.key_manager [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 29 10:56:33 devstack cinder-volume[82425]: INFO cinder.volume.manager [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_db.sqlalchemy.engines [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82425) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 10:56:33 devstack cinder-volume[82425]: INFO oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Starting 1 workers Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Started child 82596 {{(pid=82425) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Full set of CONF: {{(pid=82425) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] ******************************************************************************** {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Configuration options gathered from: {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] ================================================================================ {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] allow_availability_zone_fallback = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] allow_compression_on_image_upload = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] allowed_direct_url_schemes = [] {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] api_rate_limit = True {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] auth_strategy = keystone {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] az_cache_duration = 3600 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_availability_zone = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_host = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_name = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_stats_polling_interval = 60 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backup_api_class = cinder.backup.api.API {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backup_name_template = backup-%s {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backup_use_same_host = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backup_use_temp_snapshot = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] chap_password = **** {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82596]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] chap_username = {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cinder_internal_tenant_project_id = 22657837261943fbad774e0412afcd14 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cinder_internal_tenant_user_id = b20a8df0f6e0446d95fe541f8e74edf0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cloned_volume_same_az = True {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cluster = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] compression_format = gzip {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] compute_api_class = cinder.compute.nova.API {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] config_dir = [] {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] config_source = [] {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] control_exchange = openstack {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] debug = True {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] default_availability_zone = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] default_group_type = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] default_volume_type = lvmdriver-1 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] disk_geometry = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] driver_client_cert = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] driver_client_cert_key = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] driver_data_namespace = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] driver_ssl_cert_path = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] driver_ssl_cert_verify = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] driver_use_ssl = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] enable_force_upload = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] enable_new_services = True {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] enable_unsupported_driver = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] enabled_backends = ['lvmdriver-1'] {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] enforce_multipath_for_image_xfer = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] filter_function = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] glance_api_insecure = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] glance_api_servers = ['http://192.168.122.103/image'] {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] glance_api_ssl_compression = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] glance_ca_certificates_file = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] glance_catalog_info = image:glance:publicURL {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] glance_certfile = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] glance_keyfile = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] glance_num_retries = 3 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] glance_request_timeout = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] goodness_function = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] graceful_shutdown_timeout = 5 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] group_api_class = cinder.group.api.API {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] host = devstack {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] image_compress_on_upload = True {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] image_conversion_address_space_limit = 1 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] image_conversion_cpu_limit = 60 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] image_conversion_disable = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] image_upload_use_cinder_backend = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] image_upload_use_internal_tenant = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] image_volume_cache_enabled = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] image_volume_cache_max_count = 0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] image_volume_cache_max_size_gb = 0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] init_host_max_objects_retrieval = 0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] instance_format = [instance: %(uuid)s] {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] iscsi_target_flags = {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] iscsi_write_cache = on {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] iser_helper = tgtadm {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] iser_ip_address = 192.168.122.103 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] iser_port = 3260 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] log_color = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] log_config_append = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] log_dir = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] log_file = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] log_options = True {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] log_rotate_interval = 1 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] log_rotate_interval_type = days {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] log_rotation_type = none {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] max_age = 0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] max_logfile_count = 30 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] max_logfile_size_mb = 200 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] max_over_subscription_ratio = 20.0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] message_reap_interval = 86400 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] message_ttl = 2592000 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] migration_create_volume_timeout_secs = 300 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] monkey_patch = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] monkey_patch_modules = [] {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] my_ip = 192.168.122.103 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] no_snapshot_gb_quota = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] num_iser_scan_tries = 3 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] num_shell_tries = 3 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] num_volume_device_scan_tries = 3 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] nvmeof_conn_info_version = 1 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] nvmet_ns_id = 10 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] nvmet_port_id = 1 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] osapi_max_limit = 1000 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] osapi_volume_ext_list = [] {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] osapi_volume_listen = 0.0.0.0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] osapi_volume_listen_port = 8776 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] osapi_volume_use_ssl = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] osapi_volume_workers = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] per_volume_size_limit = -1 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] periodic_fuzzy_delay = 60 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] periodic_interval = 60 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] project_id_regex = [0-9a-f\-]+ {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] public_endpoint = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] publish_errors = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] quota_backup_gigabytes = 1000 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] quota_backups = 10 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] quota_gigabytes = 1000 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] quota_groups = 10 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] quota_snapshots = 10 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] quota_volumes = 10 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] rate_limit_burst = 0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] rate_limit_except_level = CRITICAL {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] rate_limit_interval = 0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] reinit_driver_count = 3 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] replication_device = **** {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] report_discard_supported = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] report_interval = 120 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] reservation_clean_interval = 86400 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] reservation_expire = 86400 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] reserved_image_namespaces = [] {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] reserved_percentage = 0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] rpc_response_timeout = 120 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] run_external_periodic_tasks = True {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] scst_target_driver = iscsi {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] scst_target_iqn_name = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82596]: INFO cinder.volume.manager [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] service_down_time = 720 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] shell_completion = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] snapshot_name_template = snapshot-%s {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] snapshot_same_host = True {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] split_loggers = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] state_path = /opt/stack/data/cinder {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] storage_availability_zone = nova {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] storage_protocol = iSCSI {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] syslog_log_facility = LOG_USER {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] target_helper = lioadm {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] target_ip_address = 192.168.122.103 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] target_port = 3260 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] target_protocol = iscsi {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] target_secondary_ip_addresses = [] {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] trace_flags = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] transfer_api_class = cinder.transfer.api.API {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] transport_url = **** {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] until_refresh = 0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] use_chap_auth = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] use_default_quota_class = True {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] use_journal = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] use_json = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] use_multipath_for_image_xfer = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] use_stderr = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] use_syslog = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] verify_glance_signatures = enabled {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] volume_api_class = cinder.volume.api.API {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] volume_backend_name = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] volume_clear = zero {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] volume_clear_ionice = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] volume_clear_size = 0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] volume_copy_bps_limit = 0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] volume_dd_blocksize = 1M {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] volume_name_template = volume-%s {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] volume_service_inithost_offload = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] volume_usage_audit_period = month {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] zoning_mode = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_concurrency.disable_process_locking = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.auth_section = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.auth_type = password {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.auth_version = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.cache = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.certfile = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.delay_auth_decision = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.http_connect_timeout = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.include_service_catalog = True {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.insecure = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.interface = public {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.keyfile = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.memcache_password = {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.memcache_username = {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.region_name = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.service_token_roles_required = True {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.service_type = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.token_cache_time = 300 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.103/identity {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.backend = dogpile.cache.null {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.backend_argument = **** {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.backend_expiration_time = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.config_prefix = cache.oslo {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.debug_cache_backend = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.enable_retry_client = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.enable_socket_keepalive = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.enabled = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.expiration_time = 600 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.hashclient_retry_attempts = 2 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.memcache_dead_retry = 300 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.memcache_pool_maxsize = 10 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.memcache_sasl_enabled = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.password = **** {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.proxies = [] {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.redis_db = 0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.redis_sentinel_service_name = mymaster {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.redis_server = localhost:6379 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.retry_attempts = 2 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.retry_delay = 0.0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.socket_keepalive_count = 1 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.socket_keepalive_idle = 1 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.socket_keepalive_interval = 1 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.socket_timeout = 1.0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.tls_allowed_ciphers = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.tls_cafile = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.tls_certfile = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.tls_enabled = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.tls_keyfile = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cache.username = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] coordination.backend_url = **** {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] database.asyncio_connection = **** {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] database.asyncio_slave_connection = **** {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] database.backend = sqlalchemy {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] database.connection = **** {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] database.connection_debug = 0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] database.connection_parameters = {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] database.connection_recycle_time = 3600 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] database.connection_trace = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] database.db_inc_retry_interval = True {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] database.db_max_retries = 20 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] database.db_max_retry_interval = 10 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] database.db_retry_interval = 1 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] database.max_overflow = 50 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] database.max_pool_size = 5 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] database.max_retries = 10 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] database.mysql_wsrep_sync_wait = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] database.pool_timeout = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] database.retry_interval = 10 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] database.slave_connection = **** {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] database.sqlite_synchronous = True {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] database.synchronous_reader = True {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] database.use_db_reconnect = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] profiler.connection_string = messaging:// {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] profiler.enabled = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] profiler.es_doc_type = notification {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] profiler.es_scroll_size = 10000 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] profiler.es_scroll_time = 2m {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] profiler.filter_error_trace = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] profiler.hmac_keys = **** {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] profiler.sentinel_service_name = mymaster {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] profiler.socket_timeout = 0.1 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] profiler.trace_requests = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] profiler.trace_sqlalchemy = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] profiler_jaeger.process_tags = {} {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] profiler_jaeger.service_name_prefix = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] profiler_otlp.service_name_prefix = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_policy.enforce_new_defaults = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: WARNING oslo_config.cfg [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_policy.enforce_scope = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_policy.policy_default_rule = default {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_policy.policy_file = policy.yaml {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_policy.remote_timeout = 60.0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] privsep_osbrick.group = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] privsep_osbrick.helper_command = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] privsep_osbrick.user = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cinder_sys_admin.group = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cinder_sys_admin.helper_command = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] cinder_sys_admin.user = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] service_user.auth_section = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] service_user.auth_type = password {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] service_user.cafile = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] service_user.certfile = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] service_user.collect_timing = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] service_user.insecure = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] service_user.keyfile = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] service_user.send_service_user_token = True {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] service_user.split_loggers = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] service_user.timeout = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] glance.auth_section = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] glance.auth_type = password {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] glance.certfile = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] glance.collect_timing = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] glance.insecure = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] glance.keyfile = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] glance.region_name = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] glance.split_loggers = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] glance.timeout = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.backend_availability_zone = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.chap_password = **** {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.chap_username = {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.disk_geometry = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.driver_client_cert = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.driver_client_cert_key = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.driver_data_namespace = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.driver_use_ssl = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.enable_unsupported_driver = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.extra_capabilities = {} {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.filter_function = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.goodness_function = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.iscsi_target_flags = {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.iscsi_write_cache = on {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.iser_helper = tgtadm {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.iser_ip_address = 192.168.122.103 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.iser_port = 3260 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.lvm_mirrors = 0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.lvm_share_target = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.lvm_type = auto {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.num_shell_tries = 3 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.nvmet_port_id = 1 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.replication_device = **** {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.report_discard_supported = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.reserved_percentage = 0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.scst_target_driver = iscsi {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.scst_target_iqn_name = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.storage_protocol = iSCSI {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.target_helper = tgtadm {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.target_ip_address = 192.168.122.103 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.target_port = 3260 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.target_protocol = iscsi {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack sudo[82600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.trace_flags = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.unique_fqdn_network = True {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.use_chap_auth = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack sudo[82600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.volume_backend_name = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.volume_clear = zero {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.volume_clear_ionice = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.volume_clear_size = 0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.volume_group = cinder-volumes {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_reports.file_event_handler = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_reports.log_dir = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.backend_availability_zone = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.backend_host = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.chap_password = **** {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.chap_username = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.chiscsi_conf = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.disk_geometry = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.driver_client_cert = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.driver_data_namespace = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.driver_use_ssl = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.extra_capabilities = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.filter_function = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.goodness_function = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.iser_helper = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.iser_ip_address = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.iser_port = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.iser_target_prefix = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.lvm_conf_file = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.lvm_mirrors = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.lvm_share_target = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.lvm_type = auto {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.num_shell_tries = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.nvmet_port_id = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.replication_device = **** {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.report_discard_supported = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.reserved_percentage = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.scst_target_driver = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.storage_protocol = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.target_helper = lioadm {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.target_ip_address = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.target_port = 3260 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.target_protocol = iscsi {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.trace_flags = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.use_chap_auth = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.volume_clear = zero {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.volume_clear_size = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] lvmdriver-1.volumes_dir = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.ssl = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.ssl_version = {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_notifications.driver = [] {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_notifications.retry = -1 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] oslo_messaging_notifications.transport_url = **** {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] key_manager.fixed_key = **** {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] barbican.barbican_api_version = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] barbican.barbican_endpoint = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] barbican.barbican_endpoint_type = public {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] barbican.barbican_region_name = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] barbican.cafile = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] barbican.certfile = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] barbican.collect_timing = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] barbican.insecure = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] barbican.keyfile = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] barbican.number_of_retries = 60 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] barbican.retry_delay = 1 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] barbican.send_service_user_token = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] barbican.split_loggers = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] barbican.timeout = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] barbican.verify_ssl = True {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] barbican.verify_ssl_path = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] barbican_service_user.auth_section = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] barbican_service_user.auth_type = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] barbican_service_user.cafile = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] barbican_service_user.certfile = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] barbican_service_user.collect_timing = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] barbican_service_user.insecure = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] barbican_service_user.keyfile = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] barbican_service_user.split_loggers = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] barbican_service_user.timeout = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] vault.approle_role_id = **** {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] vault.approle_secret_id = **** {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] vault.kv_mountpoint = secret {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] vault.kv_path = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] vault.kv_version = 2 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] vault.namespace = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] vault.root_token_id = **** {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] vault.ssl_ca_crt_file = None {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] vault.timeout = 60.0 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] vault.use_ssl = False {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 10:56:33 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] ******************************************************************************** {{(pid=82425) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 29 10:56:34 devstack sudo[82600]: pam_unix(sudo:session): session closed for user root Jun 29 10:56:34 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.931s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:34 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:34 devstack sudo[82793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 10:56:34 devstack sudo[82793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:56:35 devstack sudo[82793]: pam_unix(sudo:session): session closed for user root Jun 29 10:56:35 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.766s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:35 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 10:56:35 devstack cinder-volume[82596]: INFO cinder.brick.local_dev.lvm [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 29 10:56:35 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:35 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:35 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:35 devstack sudo[83011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 10:56:35 devstack sudo[83011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:56:36 devstack sudo[83011]: pam_unix(sudo:session): session closed for user root Jun 29 10:56:36 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.034s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:36 devstack cinder-volume[82596]: DEBUG cinder.brick.local_dev.lvm [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82596) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 29 10:56:36 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:36 devstack sudo[83200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 10:56:36 devstack sudo[83200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:56:37 devstack sudo[83200]: pam_unix(sudo:session): session closed for user root Jun 29 10:56:37 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.302s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:37 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:37 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:37 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:37 devstack sudo[83408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 10:56:37 devstack sudo[83408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:56:38 devstack sudo[83408]: pam_unix(sudo:session): session closed for user root Jun 29 10:56:38 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.731s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:38 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:38 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:38 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:38 devstack sudo[83412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 29 10:56:38 devstack sudo[83412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:56:39 devstack sudo[83412]: pam_unix(sudo:session): session closed for user root Jun 29 10:56:39 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.768s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:39 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:39 devstack sudo[83415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 10:56:39 devstack sudo[83415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:56:39 devstack sudo[83415]: pam_unix(sudo:session): session closed for user root Jun 29 10:56:39 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.909s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:39 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:40 devstack sudo[83418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 10:56:40 devstack sudo[83418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:56:40 devstack sudo[83418]: pam_unix(sudo:session): session closed for user root Jun 29 10:56:40 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.888s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:40 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:40 devstack sudo[83430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 10:56:40 devstack sudo[83430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:56:41 devstack sudo[83430]: pam_unix(sudo:session): session closed for user root Jun 29 10:56:41 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.894s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:41 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:41 devstack sudo[83435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 10:56:41 devstack sudo[83435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:56:42 devstack sudo[83435]: pam_unix(sudo:session): session closed for user root Jun 29 10:56:42 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.717s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:42 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:42 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:42 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:42 devstack sudo[83439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 10:56:42 devstack sudo[83439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:56:43 devstack cinder-volume[82425]: DEBUG dbcounter [-] [82425] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 10:56:43 devstack sudo[83439]: pam_unix(sudo:session): session closed for user root Jun 29 10:56:43 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.737s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:43 devstack cinder-volume[82596]: INFO cinder.volume.drivers.lvm [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 29 10:56:43 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:43 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:43 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:43 devstack sudo[83444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 10:56:43 devstack sudo[83444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:56:44 devstack sudo[83444]: pam_unix(sudo:session): session closed for user root Jun 29 10:56:44 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.016s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:44 devstack cinder-volume[82596]: DEBUG cinder.volume.drivers.lvm [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Updating volume stats {{(pid=82596) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 29 10:56:44 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:44 devstack sudo[83562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 10:56:44 devstack sudo[83562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:56:45 devstack sudo[83562]: pam_unix(sudo:session): session closed for user root Jun 29 10:56:45 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.770s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:45 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:45 devstack sudo[83637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 10:56:45 devstack sudo[83637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:56:45 devstack sudo[83637]: pam_unix(sudo:session): session closed for user root Jun 29 10:56:45 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.810s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:45 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:45 devstack sudo[83709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 10:56:45 devstack sudo[83709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:56:46 devstack sudo[83709]: pam_unix(sudo:session): session closed for user root Jun 29 10:56:46 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.683s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:46 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:46 devstack sudo[83713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 10:56:46 devstack sudo[83713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:56:47 devstack sudo[83713]: pam_unix(sudo:session): session closed for user root Jun 29 10:56:47 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.711s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:47 devstack cinder-volume[82596]: INFO cinder.volume.driver [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Driver hasn't implemented _init_vendor_properties() Jun 29 10:56:47 devstack cinder-volume[82596]: DEBUG cinder.volume.driver [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82596) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 29 10:56:47 devstack cinder-volume[82596]: DEBUG oslo_db.sqlalchemy.engines [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82596) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 10:56:47 devstack cinder-volume[82596]: DEBUG dbcounter [-] [82596] Writer thread running {{(pid=82596) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 29 10:56:47 devstack cinder-volume[82596]: DEBUG cinder.db.api [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Building query based on filter {{(pid=82596) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 29 10:56:47 devstack cinder-volume[82596]: DEBUG cinder.image.image_utils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82596) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 29 10:56:47 devstack cinder-volume[82596]: INFO cinder.keymgr.migration [None req-e197f987-2d95-4354-a29c-5dbc45c78904 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 29 10:56:47 devstack cinder-volume[82596]: DEBUG cinder.volume.drivers.lvm [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Updating volume stats {{(pid=82596) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 29 10:56:47 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:47 devstack sudo[83717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 10:56:47 devstack sudo[83717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:56:48 devstack sudo[83717]: pam_unix(sudo:session): session closed for user root Jun 29 10:56:48 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.806s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:48 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:48 devstack sudo[83722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 10:56:48 devstack sudo[83722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:56:49 devstack sudo[83722]: pam_unix(sudo:session): session closed for user root Jun 29 10:56:49 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.811s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:49 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:49 devstack sudo[83728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 10:56:49 devstack sudo[83728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:56:49 devstack sudo[83728]: pam_unix(sudo:session): session closed for user root Jun 29 10:56:49 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.796s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:49 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:49 devstack sudo[83731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 10:56:49 devstack sudo[83731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:56:50 devstack sudo[83731]: pam_unix(sudo:session): session closed for user root Jun 29 10:56:50 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.801s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:50 devstack cinder-volume[82596]: DEBUG cinder.manager [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Notifying Schedulers of capabilities ... {{(pid=82596) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 10:56:50 devstack cinder-volume[82596]: INFO cinder.volume.manager [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Driver initialization completed successfully. Jun 29 10:56:50 devstack cinder-volume[82596]: INFO cinder.manager [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Initiating service 2 cleanup Jun 29 10:56:50 devstack cinder-volume[82596]: INFO cinder.manager [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Service 2 cleanup completed. Jun 29 10:56:50 devstack cinder-volume[82596]: DEBUG cinder.service [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Creating RPC server for service cinder-volume {{(pid=82596) start /opt/stack/cinder/cinder/service.py:231}} Jun 29 10:56:50 devstack cinder-volume[82596]: DEBUG cinder.service [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82596) start /opt/stack/cinder/cinder/service.py:237}} Jun 29 10:56:50 devstack cinder-volume[82596]: INFO cinder.volume.manager [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 29 10:56:50 devstack cinder-volume[82596]: DEBUG cinder.volume.drivers.lvm [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Updating volume stats {{(pid=82596) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 29 10:56:50 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:50 devstack sudo[83735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 10:56:50 devstack sudo[83735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:56:51 devstack sudo[83735]: pam_unix(sudo:session): session closed for user root Jun 29 10:56:51 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.830s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:51 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:51 devstack sudo[83739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 10:56:51 devstack sudo[83739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:56:52 devstack sudo[83739]: pam_unix(sudo:session): session closed for user root Jun 29 10:56:52 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.968s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:52 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:52 devstack sudo[83744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 10:56:52 devstack sudo[83744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:56:53 devstack sudo[83744]: pam_unix(sudo:session): session closed for user root Jun 29 10:56:53 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.766s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:53 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:56:53 devstack sudo[83802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 10:56:53 devstack sudo[83802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:56:54 devstack sudo[83802]: pam_unix(sudo:session): session closed for user root Jun 29 10:56:54 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.701s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:56:54 devstack cinder-volume[82596]: INFO cinder.volume.manager [None req-15586322-9e75-40ef-aed3-35b2cd60a3c1 None None] Driver post RPC initialization completed successfully. Jun 29 10:57:00 devstack cinder-volume[82596]: DEBUG dbcounter [-] [82596] Writing DB stats cinder:SELECT=3 {{(pid=82596) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 10:57:04 devstack cinder-volume[82596]: DEBUG dbcounter [-] [82596] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82596) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 10:57:11 devstack cinder-volume[82596]: DEBUG oslo_service.periodic_task [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Running periodic task VolumeManager._thread_info {{(pid=82596) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 10:57:11 devstack cinder-volume[82596]: DEBUG cinder.volume.manager [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] thread count: 6 {{(pid=82596) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 10:57:11 devstack cinder-volume[82596]: DEBUG cinder.volume.manager [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] thread info: [<_MainThread(MainThread, started 132967243944064)>, , , , , ] {{(pid=82596) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 10:58:11 devstack cinder-volume[82596]: DEBUG oslo_service.periodic_task [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82596) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 10:58:11 devstack cinder-volume[82596]: DEBUG cinder.volume.drivers.lvm [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Updating volume stats {{(pid=82596) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 29 10:58:11 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:58:11 devstack sudo[85827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 10:58:11 devstack sudo[85827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:58:11 devstack sudo[85827]: pam_unix(sudo:session): session closed for user root Jun 29 10:58:11 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.704s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:58:11 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:58:11 devstack sudo[85833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 10:58:11 devstack sudo[85833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:58:12 devstack sudo[85833]: pam_unix(sudo:session): session closed for user root Jun 29 10:58:12 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.681s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:58:12 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:58:12 devstack sudo[85836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 10:58:12 devstack sudo[85836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:58:13 devstack sudo[85836]: pam_unix(sudo:session): session closed for user root Jun 29 10:58:13 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.717s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:58:13 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:58:13 devstack sudo[85855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 10:58:13 devstack sudo[85855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:58:14 devstack sudo[85855]: pam_unix(sudo:session): session closed for user root Jun 29 10:58:14 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.696s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:58:14 devstack cinder-volume[82596]: DEBUG cinder.manager [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Notifying Schedulers of capabilities ... {{(pid=82596) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 10:58:14 devstack cinder-volume[82596]: DEBUG oslo_service.periodic_task [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Running periodic task VolumeManager._thread_info {{(pid=82596) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 10:58:14 devstack cinder-volume[82596]: DEBUG cinder.volume.manager [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] thread count: 6 {{(pid=82596) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 10:58:14 devstack cinder-volume[82596]: DEBUG cinder.volume.manager [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] thread info: [<_MainThread(MainThread, started 132967243944064)>, , , , , ] {{(pid=82596) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 10:59:04 devstack cinder-volume[82596]: DEBUG dbcounter [-] [82596] Writing DB stats cinder:SELECT=1 {{(pid=82596) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 10:59:04 devstack cinder-volume[82596]: DEBUG dbcounter [-] [82596] Writing DB stats cinder:UPDATE=1 {{(pid=82596) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 10:59:11 devstack cinder-volume[82596]: DEBUG oslo_service.periodic_task [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82596) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 10:59:11 devstack cinder-volume[82596]: DEBUG cinder.volume.drivers.lvm [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Updating volume stats {{(pid=82596) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 29 10:59:11 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:59:11 devstack sudo[88814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 10:59:11 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:59:11 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root Jun 29 10:59:11 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.731s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:59:11 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:59:11 devstack sudo[88822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 10:59:11 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:59:12 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root Jun 29 10:59:12 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.686s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:59:12 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:59:12 devstack sudo[88832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 10:59:12 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:59:13 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root Jun 29 10:59:13 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.754s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:59:13 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 10:59:13 devstack sudo[88841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 10:59:13 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 10:59:14 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root Jun 29 10:59:14 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.739s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 10:59:14 devstack cinder-volume[82596]: DEBUG cinder.manager [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Notifying Schedulers of capabilities ... {{(pid=82596) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 10:59:14 devstack cinder-volume[82596]: DEBUG oslo_service.periodic_task [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Running periodic task VolumeManager._thread_info {{(pid=82596) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 10:59:14 devstack cinder-volume[82596]: DEBUG cinder.volume.manager [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] thread count: 6 {{(pid=82596) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 10:59:14 devstack cinder-volume[82596]: DEBUG cinder.volume.manager [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] thread info: [<_MainThread(MainThread, started 132967243944064)>, , , , , ] {{(pid=82596) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 11:00:11 devstack cinder-volume[82596]: DEBUG oslo_service.periodic_task [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82596) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:00:11 devstack cinder-volume[82596]: DEBUG cinder.volume.drivers.lvm [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Updating volume stats {{(pid=82596) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 29 11:00:11 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:00:11 devstack sudo[89889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 11:00:11 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:00:11 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root Jun 29 11:00:11 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.740s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:00:11 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:00:11 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 11:00:11 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:00:12 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Jun 29 11:00:12 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.707s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:00:12 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:00:12 devstack sudo[89980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 11:00:12 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:00:13 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root Jun 29 11:00:13 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.703s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:00:13 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:00:13 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 11:00:13 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:00:14 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Jun 29 11:00:14 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.730s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:00:14 devstack cinder-volume[82596]: DEBUG cinder.manager [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Notifying Schedulers of capabilities ... {{(pid=82596) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:01:04 devstack cinder-volume[82596]: DEBUG dbcounter [-] [82596] Writing DB stats cinder:SELECT=1 {{(pid=82596) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:01:04 devstack cinder-volume[82596]: DEBUG dbcounter [-] [82596] Writing DB stats cinder:UPDATE=1 {{(pid=82596) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:01:11 devstack cinder-volume[82596]: DEBUG oslo_service.periodic_task [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82596) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:01:11 devstack cinder-volume[82596]: DEBUG cinder.volume.drivers.lvm [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Updating volume stats {{(pid=82596) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 29 11:01:11 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:01:11 devstack sudo[91356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 11:01:11 devstack sudo[91356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:01:11 devstack sudo[91356]: pam_unix(sudo:session): session closed for user root Jun 29 11:01:11 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.764s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:01:11 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:01:12 devstack sudo[91359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 11:01:12 devstack sudo[91359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:01:12 devstack sudo[91359]: pam_unix(sudo:session): session closed for user root Jun 29 11:01:12 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.704s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:01:12 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:01:12 devstack sudo[91364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 11:01:12 devstack sudo[91364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:01:13 devstack sudo[91364]: pam_unix(sudo:session): session closed for user root Jun 29 11:01:13 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.758s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:01:13 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:01:13 devstack sudo[91370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 11:01:13 devstack sudo[91370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:01:14 devstack sudo[91370]: pam_unix(sudo:session): session closed for user root Jun 29 11:01:14 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.859s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:01:14 devstack cinder-volume[82596]: DEBUG cinder.manager [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Notifying Schedulers of capabilities ... {{(pid=82596) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:01:14 devstack cinder-volume[82596]: DEBUG oslo_service.periodic_task [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Running periodic task VolumeManager._thread_info {{(pid=82596) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:01:14 devstack cinder-volume[82596]: DEBUG cinder.volume.manager [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] thread count: 6 {{(pid=82596) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 11:01:14 devstack cinder-volume[82596]: DEBUG cinder.volume.manager [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] thread info: [<_MainThread(MainThread, started 132967243944064)>, , , , , ] {{(pid=82596) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 11:02:11 devstack cinder-volume[82596]: DEBUG oslo_service.periodic_task [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82596) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:02:11 devstack cinder-volume[82596]: DEBUG cinder.volume.drivers.lvm [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Updating volume stats {{(pid=82596) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 29 11:02:11 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:02:11 devstack sudo[92324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 11:02:11 devstack sudo[92324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:02:11 devstack sudo[92324]: pam_unix(sudo:session): session closed for user root Jun 29 11:02:11 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.726s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:02:11 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:02:11 devstack sudo[92328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 11:02:11 devstack sudo[92328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:02:12 devstack sudo[92328]: pam_unix(sudo:session): session closed for user root Jun 29 11:02:12 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.789s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:02:12 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:02:12 devstack sudo[92342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 11:02:12 devstack sudo[92342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:02:13 devstack sudo[92342]: pam_unix(sudo:session): session closed for user root Jun 29 11:02:13 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.769s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:02:13 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:02:13 devstack sudo[92368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 11:02:13 devstack sudo[92368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:02:14 devstack sudo[92368]: pam_unix(sudo:session): session closed for user root Jun 29 11:02:14 devstack cinder-volume[82596]: DEBUG oslo_concurrency.processutils [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.733s {{(pid=82596) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:02:14 devstack cinder-volume[82596]: DEBUG cinder.manager [None req-6865adee-76e5-4ef1-98f8-1fee1cc40aff None None] Notifying Schedulers of capabilities ... {{(pid=82596) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:02:25 devstack cinder-volume[82425]: INFO oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Caught SIGTERM, stopping children Jun 29 11:02:25 devstack cinder-volume[82425]: DEBUG oslo_concurrency.lockutils [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Acquiring lock "singleton_lock" {{(pid=82425) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 29 11:02:25 devstack cinder-volume[82425]: DEBUG oslo_concurrency.lockutils [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Acquired lock "singleton_lock" {{(pid=82425) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 29 11:02:25 devstack cinder-volume[82425]: DEBUG oslo_concurrency.lockutils [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Releasing lock "singleton_lock" {{(pid=82425) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 29 11:02:25 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Stop services. {{(pid=82425) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 29 11:02:25 devstack cinder-volume[82425]: DEBUG oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Killing children. {{(pid=82425) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 29 11:02:25 devstack cinder-volume[82425]: INFO oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Waiting on 1 children to exit Jun 29 11:02:30 devstack cinder-volume[82596]: DEBUG oslo_concurrency.lockutils [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Acquiring lock "singleton_lock" {{(pid=82596) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 29 11:02:30 devstack cinder-volume[82596]: DEBUG oslo_concurrency.lockutils [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Acquired lock "singleton_lock" {{(pid=82596) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 29 11:02:30 devstack cinder-volume[82596]: DEBUG oslo_concurrency.lockutils [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Releasing lock "singleton_lock" {{(pid=82596) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 29 11:02:30 devstack cinder-volume[82596]: WARNING amqp [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 29 11:02:30 devstack cinder-volume[82596]: WARNING amqp [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 29 11:02:30 devstack cinder-volume[82425]: INFO oslo_service.backend._eventlet.service [None req-b4e2012e-a19c-4127-b799-a48f7bf1b3ae None None] Child 82596 exited with status 0 Jun 29 11:02:31 devstack cinder-volume[92722]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 29 11:02:31 devstack cinder-volume[92722]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 29 11:02:31 devstack cinder-volume[92722]: we strongly recommend against using it for new projects. Jun 29 11:02:31 devstack cinder-volume[92722]: If you are already using Eventlet, we recommend migrating to a different Jun 29 11:02:31 devstack cinder-volume[92722]: framework. For more detail see Jun 29 11:02:31 devstack cinder-volume[92722]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 29 11:02:31 devstack cinder-volume[92722]: import eventlet # noqa Jun 29 11:02:33 devstack cinder-volume[92722]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92722) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 29 11:02:33 devstack cinder-volume[92722]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92722) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 29 11:02:33 devstack cinder-volume[92722]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92722) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 29 11:02:34 devstack cinder-volume[92722]: INFO dbcounter [None req-46da7c90-5916-4993-8268-daf134f40eee None None] Registered counter for database cinder Jun 29 11:02:34 devstack cinder-volume[92722]: DEBUG oslo_db.sqlalchemy.engines [None req-46da7c90-5916-4993-8268-daf134f40eee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92722) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG dbcounter [-] [92722] Writer thread running {{(pid=92722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 29 11:02:35 devstack cinder-volume[92722]: INFO cinder.rpc [None req-46da7c90-5916-4993-8268-daf134f40eee None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 29 11:02:35 devstack cinder-volume[92722]: INFO cinder.rpc [None req-46da7c90-5916-4993-8268-daf134f40eee None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_db.sqlalchemy.engines [None req-46da7c90-5916-4993-8268-daf134f40eee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92722) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 11:02:35 devstack cinder-volume[92722]: INFO cinder.volume.manager [None req-46da7c90-5916-4993-8268-daf134f40eee None None] Determined volume DB was empty at startup. Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG cinder.volume.manager [None req-46da7c90-5916-4993-8268-daf134f40eee None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92722) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 29 11:02:35 devstack cinder-volume[92722]: INFO cinder.volume.manager [None req-46da7c90-5916-4993-8268-daf134f40eee None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 29 11:02:35 devstack cinder-volume[92722]: WARNING stevedore.named [None req-46da7c90-5916-4993-8268-daf134f40eee None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 29 11:02:35 devstack cinder-volume[92722]: WARNING castellan.key_manager [None req-46da7c90-5916-4993-8268-daf134f40eee None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 29 11:02:35 devstack cinder-volume[92722]: WARNING cinder.keymgr.conf_key_mgr [None req-46da7c90-5916-4993-8268-daf134f40eee None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 29 11:02:35 devstack cinder-volume[92722]: INFO cinder.volume.manager [None req-46da7c90-5916-4993-8268-daf134f40eee None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_db.sqlalchemy.engines [None req-46da7c90-5916-4993-8268-daf134f40eee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92722) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 11:02:35 devstack cinder-volume[92722]: INFO oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] Starting 1 workers Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] Started child 92941 {{(pid=92722) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] Full set of CONF: {{(pid=92722) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] ******************************************************************************** {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] Configuration options gathered from: {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] ================================================================================ {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] allow_availability_zone_fallback = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] allow_compression_on_image_upload = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] allowed_direct_url_schemes = [] {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] api_rate_limit = True {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] auth_strategy = keystone {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92941]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_availability_zone = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_host = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_name = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_stats_polling_interval = 60 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backup_api_class = cinder.backup.api.API {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backup_name_template = backup-%s {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backup_use_same_host = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backup_use_temp_snapshot = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] chap_password = **** {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] chap_username = {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cinder_internal_tenant_project_id = 22657837261943fbad774e0412afcd14 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cinder_internal_tenant_user_id = b20a8df0f6e0446d95fe541f8e74edf0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cluster = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] compression_format = gzip {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] compute_api_class = cinder.compute.nova.API {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] config_dir = [] {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] config_source = [] {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] control_exchange = openstack {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] debug = True {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] default_availability_zone = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] default_group_type = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] default_volume_type = QuobyteHD {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] disk_geometry = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] driver_client_cert = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] driver_client_cert_key = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] driver_data_namespace = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] driver_ssl_cert_path = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] driver_ssl_cert_verify = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] driver_use_ssl = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] enable_new_services = True {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] enable_unsupported_driver = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] enabled_backends = ['QuobyteHD'] {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] enforce_multipath_for_image_xfer = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] filter_function = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] glance_api_insecure = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] glance_api_servers = ['http://192.168.122.103/image'] {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] glance_api_ssl_compression = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] glance_ca_certificates_file = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] glance_catalog_info = image:glance:publicURL {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] glance_certfile = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] glance_keyfile = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] glance_num_retries = 3 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] glance_request_timeout = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] goodness_function = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] graceful_shutdown_timeout = 5 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] group_api_class = cinder.group.api.API {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] host = devstack {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] image_compress_on_upload = True {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] image_conversion_address_space_limit = 1 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] image_conversion_cpu_limit = 60 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] image_conversion_disable = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] image_upload_use_cinder_backend = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] image_upload_use_internal_tenant = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] image_volume_cache_enabled = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] image_volume_cache_max_count = 0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] image_volume_cache_max_size_gb = 0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] init_host_max_objects_retrieval = 0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] instance_format = [instance: %(uuid)s] {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92941]: INFO cinder.volume.manager [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] iscsi_target_flags = {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] iscsi_write_cache = on {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] iser_helper = tgtadm {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92941]: DEBUG cinder.volume.drivers.remotefs [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=92941) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] iser_ip_address = 192.168.122.103 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] iser_port = 3260 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] log_color = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] log_config_append = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] log_dir = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] log_file = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] log_options = True {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] log_rotate_interval = 1 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] log_rotate_interval_type = days {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] log_rotation_type = none {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] max_age = 0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] max_logfile_count = 30 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] max_logfile_size_mb = 200 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] max_over_subscription_ratio = 20.0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] message_reap_interval = 86400 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] message_ttl = 2592000 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] migration_create_volume_timeout_secs = 300 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] monkey_patch = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] monkey_patch_modules = [] {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] my_ip = 192.168.122.103 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] no_snapshot_gb_quota = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] num_iser_scan_tries = 3 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] num_shell_tries = 3 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] num_volume_device_scan_tries = 3 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] nvmeof_conn_info_version = 1 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] nvmet_ns_id = 10 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] nvmet_port_id = 1 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] osapi_max_limit = 1000 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] osapi_volume_ext_list = [] {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] osapi_volume_listen = 0.0.0.0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] osapi_volume_listen_port = 8776 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] osapi_volume_use_ssl = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] osapi_volume_workers = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] per_volume_size_limit = -1 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] periodic_fuzzy_delay = 60 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] periodic_interval = 60 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] project_id_regex = [0-9a-f\-]+ {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] public_endpoint = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] publish_errors = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] quota_backup_gigabytes = 1000 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] quota_backups = 10 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] quota_gigabytes = 1000 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] quota_groups = 10 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] quota_snapshots = 10 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] quota_volumes = 10 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] rate_limit_burst = 0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] rate_limit_except_level = CRITICAL {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] rate_limit_interval = 0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] reinit_driver_count = 3 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] replication_device = **** {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] report_discard_supported = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] report_interval = 120 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] reservation_clean_interval = 86400 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] reservation_expire = 86400 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] reserved_image_namespaces = [] {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] reserved_percentage = 0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] rpc_response_timeout = 120 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] run_external_periodic_tasks = True {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] scst_target_driver = iscsi {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] scst_target_iqn_name = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] service_down_time = 720 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] shell_completion = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] snapshot_name_template = snapshot-%s {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] split_loggers = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] state_path = /opt/stack/data/cinder {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] storage_availability_zone = nova {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] storage_protocol = iSCSI {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] syslog_log_facility = LOG_USER {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] target_helper = lioadm {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] target_ip_address = 192.168.122.103 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] target_port = 3260 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] target_protocol = iscsi {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] target_secondary_ip_addresses = [] {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] trace_flags = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] transfer_api_class = cinder.transfer.api.API {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] transport_url = **** {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] until_refresh = 0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] use_chap_auth = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] use_default_quota_class = True {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] use_journal = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] use_json = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] use_multipath_for_image_xfer = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] use_stderr = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] use_syslog = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] verify_glance_signatures = enabled {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] volume_api_class = cinder.volume.api.API {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] volume_backend_name = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] volume_clear = zero {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] volume_clear_ionice = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] volume_clear_size = 0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] volume_copy_bps_limit = 0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] volume_dd_blocksize = 1M {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] volume_name_template = volume-%s {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] volume_service_inithost_offload = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] volume_usage_audit_period = month {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] zoning_mode = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_concurrency.disable_process_locking = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.auth_section = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.auth_type = password {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.auth_version = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.cache = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.certfile = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.delay_auth_decision = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.http_connect_timeout = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.include_service_catalog = True {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.insecure = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.interface = public {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.keyfile = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.memcache_password = {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92941]: DEBUG cinder.volume.drivers.quobyte [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=92941) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 29 11:02:35 devstack cinder-volume[92941]: WARNING cinder.volume.drivers.quobyte [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92941]: WARNING cinder.volume.drivers.quobyte [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.memcache_username = {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92941]: DEBUG oslo_concurrency.processutils [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Running cmd (subprocess): mount.quobyte {{(pid=92941) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.region_name = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.service_token_roles_required = True {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.service_type = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.token_cache_time = 300 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.103/identity {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.backend = dogpile.cache.null {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.backend_argument = **** {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.backend_expiration_time = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.config_prefix = cache.oslo {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.debug_cache_backend = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.enable_retry_client = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.enable_socket_keepalive = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.enabled = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.expiration_time = 600 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.hashclient_dead_timeout = 60.0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.hashclient_retry_attempts = 2 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.memcache_dead_retry = 300 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.memcache_pool_maxsize = 10 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.memcache_sasl_enabled = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.memcache_servers = ['localhost:11211'] {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.password = **** {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.proxies = [] {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.redis_db = 0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.redis_sentinel_service_name = mymaster {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.redis_server = localhost:6379 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.retry_attempts = 2 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.retry_delay = 0.0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.socket_keepalive_count = 1 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.socket_keepalive_idle = 1 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.socket_keepalive_interval = 1 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.socket_timeout = 1.0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.tls_allowed_ciphers = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.tls_cafile = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.tls_certfile = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.tls_enabled = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.tls_keyfile = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cache.username = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] coordination.backend_url = **** {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] database.asyncio_connection = **** {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] database.asyncio_slave_connection = **** {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] database.backend = sqlalchemy {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] database.connection = **** {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] database.connection_debug = 0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] database.connection_parameters = {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] database.connection_recycle_time = 3600 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] database.connection_trace = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] database.db_inc_retry_interval = True {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] database.db_max_retries = 20 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] database.db_max_retry_interval = 10 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] database.db_retry_interval = 1 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] database.max_overflow = 50 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] database.max_pool_size = 5 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] database.max_retries = 10 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] database.mysql_sql_mode = TRADITIONAL {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] database.mysql_wsrep_sync_wait = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] database.pool_timeout = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] database.retry_interval = 10 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] database.slave_connection = **** {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] database.sqlite_synchronous = True {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] database.synchronous_reader = True {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] database.use_db_reconnect = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_metrics.metrics_process_name = {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] profiler.connection_string = messaging:// {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] profiler.enabled = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] profiler.es_doc_type = notification {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] profiler.es_scroll_size = 10000 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] profiler.es_scroll_time = 2m {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] profiler.filter_error_trace = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] profiler.hmac_keys = **** {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] profiler.sentinel_service_name = mymaster {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] profiler.socket_timeout = 0.1 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] profiler.trace_requests = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] profiler.trace_sqlalchemy = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] profiler_jaeger.process_tags = {} {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] profiler_jaeger.service_name_prefix = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] profiler_otlp.service_name_prefix = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_policy.enforce_new_defaults = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: WARNING oslo_config.cfg [None req-46da7c90-5916-4993-8268-daf134f40eee None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_policy.enforce_scope = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_policy.policy_default_rule = default {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_policy.policy_file = policy.yaml {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_policy.remote_timeout = 60.0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] privsep_osbrick.capabilities = [21, 2] {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] privsep_osbrick.group = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] privsep_osbrick.helper_command = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] privsep_osbrick.user = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cinder_sys_admin.group = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack quobyte-client[92944]: Reading configuration file: /etc/quobyte/client.cfg Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cinder_sys_admin.helper_command = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] cinder_sys_admin.user = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] service_user.auth_section = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] service_user.auth_type = password {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack quobyte-client[92944]: Invalid parameters found, error: missing mount point. Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] service_user.cafile = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] service_user.certfile = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] service_user.collect_timing = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] service_user.insecure = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] service_user.keyfile = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] service_user.send_service_user_token = True {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] service_user.split_loggers = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack quobyte-client[92944]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] service_user.timeout = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] glance.auth_section = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] glance.auth_type = password {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] glance.certfile = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] glance.collect_timing = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] glance.insecure = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack quobyte-client[92944]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] glance.keyfile = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] glance.region_name = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] glance.split_loggers = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] glance.timeout = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.backend_availability_zone = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.chap_password = **** {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.chap_username = {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.disk_geometry = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.driver_client_cert = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.driver_client_cert_key = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.driver_data_namespace = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.driver_use_ssl = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.enable_unsupported_driver = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.extra_capabilities = {} {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.filter_function = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.goodness_function = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.iscsi_target_flags = {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.iscsi_write_cache = on {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.iser_helper = tgtadm {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.iser_ip_address = 192.168.122.103 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.iser_port = 3260 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.nas_host = {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.nas_login = admin {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.nas_mount_options = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.nas_password = **** {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.nas_private_key = {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.nas_share_path = {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.nas_ssh_port = 22 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.num_shell_tries = 3 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.nvmet_ns_id = 10 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.nvmet_port_id = 1 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.quobyte_client_cfg = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.quobyte_volume_url = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.replication_device = **** {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.report_discard_supported = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.reserved_percentage = 0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.scst_target_driver = iscsi {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.scst_target_iqn_name = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.storage_protocol = iSCSI {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.target_helper = tgtadm {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.target_ip_address = 192.168.122.103 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.target_port = 3260 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.target_protocol = iscsi {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.trace_flags = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.unique_fqdn_network = True {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.use_chap_auth = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.volume_backend_name = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.volume_clear = zero {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.volume_clear_ionice = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.volume_clear_size = 0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_reports.file_event_handler = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_reports.log_dir = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.backend_availability_zone = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.backend_host = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.chap_password = **** {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.chap_username = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.chiscsi_conf = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.disk_geometry = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.driver_client_cert = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.driver_client_cert_key = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.driver_data_namespace = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92941]: DEBUG oslo_concurrency.processutils [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] CMD "mount.quobyte" returned: 1 in 0.094s {{(pid=92941) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.driver_use_ssl = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.enable_unsupported_driver = True {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.extra_capabilities = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92941]: DEBUG oslo_concurrency.lockutils [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92941) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.filter_function = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92941]: DEBUG oslo_concurrency.lockutils [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92941) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.goodness_function = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92941]: DEBUG cinder.volume.drivers.quobyte [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=92941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92941]: INFO cinder.volume.drivers.quobyte [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 ... Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92941]: DEBUG oslo_concurrency.processutils [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 -c /etc/quobyte/client-cinder.cfg {{(pid=92941) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.iscsi_target_flags = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.iscsi_write_cache = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.iser_helper = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.iser_ip_address = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.iser_port = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.iser_target_prefix = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.nas_host = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.nas_login = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.nas_mount_options = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.nas_password = **** {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.nas_private_key = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.nas_share_path = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.nas_ssh_port = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.num_iser_scan_tries = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.num_shell_tries = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.nvmet_ns_id = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.nvmet_port_id = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.replication_device = **** {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.report_discard_supported = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.reserved_percentage = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.scst_target_driver = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.storage_protocol = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.target_helper = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.target_ip_address = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.target_port = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.target_prefix = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.target_protocol = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.trace_flags = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.unique_fqdn_network = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.use_chap_auth = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.volume_clear = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.volume_clear_ionice = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.volume_clear_size = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.volume_dd_blocksize = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] QuobyteHD.volumes_dir = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.ssl = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.ssl_version = {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_notifications.driver = [] {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_notifications.retry = -1 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] oslo_messaging_notifications.transport_url = **** {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] key_manager.fixed_key = **** {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] barbican.barbican_api_version = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] barbican.barbican_endpoint = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] barbican.barbican_endpoint_type = public {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] barbican.barbican_region_name = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] barbican.cafile = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] barbican.certfile = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] barbican.collect_timing = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] barbican.insecure = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] barbican.keyfile = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] barbican.number_of_retries = 60 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] barbican.retry_delay = 1 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] barbican.send_service_user_token = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] barbican.split_loggers = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] barbican.timeout = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] barbican.verify_ssl = True {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] barbican.verify_ssl_path = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] barbican_service_user.auth_section = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] barbican_service_user.auth_type = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] barbican_service_user.cafile = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] barbican_service_user.certfile = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack sudo[92945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 -c /etc/quobyte/client-cinder.cfg Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] barbican_service_user.collect_timing = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] barbican_service_user.insecure = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] barbican_service_user.keyfile = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] barbican_service_user.split_loggers = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] barbican_service_user.timeout = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] vault.approle_role_id = **** {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] vault.approle_secret_id = **** {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] vault.kv_mountpoint = secret {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] vault.kv_path = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] vault.kv_version = 2 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack sudo[92945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] vault.namespace = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] vault.root_token_id = **** {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] vault.ssl_ca_crt_file = None {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] vault.timeout = 60.0 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] vault.use_ssl = False {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:35 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] ******************************************************************************** {{(pid=92722) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 29 11:02:36 devstack sudo[92945]: pam_unix(sudo:session): session closed for user root Jun 29 11:02:36 devstack cinder-volume[92941]: DEBUG oslo_concurrency.processutils [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.871s {{(pid=92941) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:02:36 devstack cinder-volume[92941]: INFO cinder.volume.drivers.quobyte [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 succeeded Jun 29 11:02:36 devstack cinder-volume[92941]: DEBUG cinder.volume.drivers.quobyte [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=92941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:02:36 devstack cinder-volume[92941]: DEBUG oslo_concurrency.lockutils [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.895s {{(pid=92941) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:02:36 devstack cinder-volume[92941]: DEBUG oslo_concurrency.processutils [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=92941) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:02:36 devstack sudo[93015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:02:36 devstack sudo[93015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:02:37 devstack sudo[93015]: pam_unix(sudo:session): session closed for user root Jun 29 11:02:37 devstack cinder-volume[92941]: DEBUG oslo_concurrency.processutils [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.762s {{(pid=92941) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:02:37 devstack cinder-volume[92941]: INFO cinder.volume.driver [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Driver hasn't implemented _init_vendor_properties() Jun 29 11:02:37 devstack cinder-volume[92941]: DEBUG cinder.volume.driver [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4758987426758, 'free_capacity_gb': 1775.4758987426758, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92941) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 29 11:02:37 devstack cinder-volume[92941]: DEBUG oslo_db.sqlalchemy.engines [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92941) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 11:02:37 devstack cinder-volume[92941]: DEBUG dbcounter [-] [92941] Writer thread running {{(pid=92941) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 29 11:02:37 devstack cinder-volume[92941]: DEBUG cinder.db.api [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Building query based on filter {{(pid=92941) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 29 11:02:37 devstack cinder-volume[92941]: DEBUG cinder.image.image_utils [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=92941) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 29 11:02:37 devstack cinder-volume[92941]: INFO cinder.keymgr.migration [None req-666ce92f-dc16-4236-8e5b-3a6e99aeddcd None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 29 11:02:37 devstack cinder-volume[92941]: DEBUG oslo_concurrency.lockutils [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92941) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:02:37 devstack cinder-volume[92941]: DEBUG oslo_concurrency.lockutils [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92941) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:02:37 devstack cinder-volume[92941]: DEBUG cinder.volume.drivers.quobyte [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=92941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:02:37 devstack cinder-volume[92941]: DEBUG cinder.volume.drivers.quobyte [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=92941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:02:37 devstack cinder-volume[92941]: DEBUG oslo_concurrency.lockutils [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92941) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:02:37 devstack cinder-volume[92941]: DEBUG oslo_concurrency.processutils [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=92941) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:02:37 devstack sudo[93018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:02:37 devstack sudo[93018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:02:38 devstack sudo[93018]: pam_unix(sudo:session): session closed for user root Jun 29 11:02:38 devstack cinder-volume[92941]: DEBUG oslo_concurrency.processutils [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.858s {{(pid=92941) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:02:38 devstack cinder-volume[92941]: DEBUG cinder.manager [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Notifying Schedulers of capabilities ... {{(pid=92941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:02:38 devstack cinder-volume[92941]: INFO cinder.volume.manager [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Driver initialization completed successfully. Jun 29 11:02:38 devstack cinder-volume[92941]: INFO cinder.manager [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Initiating service 3 cleanup Jun 29 11:02:38 devstack cinder-volume[92941]: INFO cinder.manager [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Service 3 cleanup completed. Jun 29 11:02:38 devstack cinder-volume[92941]: DEBUG cinder.service [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Creating RPC server for service cinder-volume {{(pid=92941) start /opt/stack/cinder/cinder/service.py:231}} Jun 29 11:02:38 devstack cinder-volume[92941]: DEBUG cinder.service [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=92941) start /opt/stack/cinder/cinder/service.py:237}} Jun 29 11:02:38 devstack cinder-volume[92941]: INFO cinder.volume.manager [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 29 11:02:38 devstack cinder-volume[92941]: DEBUG oslo_concurrency.lockutils [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92941) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:02:38 devstack cinder-volume[92941]: DEBUG oslo_concurrency.lockutils [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92941) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:02:38 devstack cinder-volume[92941]: DEBUG cinder.volume.drivers.quobyte [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=92941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:02:38 devstack cinder-volume[92941]: DEBUG cinder.volume.drivers.quobyte [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=92941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:02:38 devstack cinder-volume[92941]: DEBUG oslo_concurrency.lockutils [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92941) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:02:38 devstack cinder-volume[92941]: DEBUG oslo_concurrency.processutils [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=92941) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:02:38 devstack sudo[93086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:02:38 devstack sudo[93086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:02:40 devstack sudo[93086]: pam_unix(sudo:session): session closed for user root Jun 29 11:02:40 devstack cinder-volume[92941]: DEBUG oslo_concurrency.processutils [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.282s {{(pid=92941) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:02:40 devstack cinder-volume[92941]: INFO cinder.volume.manager [None req-7359d464-1782-4f45-b2ee-25bbaffb1b38 None None] Driver post RPC initialization completed successfully. Jun 29 11:02:43 devstack cinder-volume[92941]: DEBUG oslo_concurrency.lockutils [None req-a5df7dc6-6012-4a39-91a4-b4408b3ebaf3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92941) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:02:43 devstack cinder-volume[92941]: DEBUG oslo_concurrency.lockutils [None req-a5df7dc6-6012-4a39-91a4-b4408b3ebaf3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92941) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:02:43 devstack cinder-volume[92941]: DEBUG cinder.volume.drivers.quobyte [None req-a5df7dc6-6012-4a39-91a4-b4408b3ebaf3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=92941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:02:43 devstack cinder-volume[92941]: DEBUG cinder.volume.drivers.quobyte [None req-a5df7dc6-6012-4a39-91a4-b4408b3ebaf3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=92941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:02:43 devstack cinder-volume[92941]: DEBUG oslo_concurrency.lockutils [None req-a5df7dc6-6012-4a39-91a4-b4408b3ebaf3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92941) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:02:43 devstack cinder-volume[92941]: DEBUG oslo_concurrency.processutils [None req-a5df7dc6-6012-4a39-91a4-b4408b3ebaf3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=92941) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:02:43 devstack sudo[93177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:02:43 devstack sudo[93177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:02:44 devstack sudo[93177]: pam_unix(sudo:session): session closed for user root Jun 29 11:02:44 devstack cinder-volume[92941]: DEBUG oslo_concurrency.processutils [None req-a5df7dc6-6012-4a39-91a4-b4408b3ebaf3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.794s {{(pid=92941) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:02:44 devstack cinder-volume[92941]: DEBUG cinder.manager [None req-a5df7dc6-6012-4a39-91a4-b4408b3ebaf3 None None] Notifying Schedulers of capabilities ... {{(pid=92941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:02:45 devstack cinder-volume[92722]: DEBUG dbcounter [-] [92722] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=92722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:02:46 devstack cinder-volume[92722]: INFO oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] Caught SIGTERM, stopping children Jun 29 11:02:46 devstack cinder-volume[92722]: DEBUG oslo_concurrency.lockutils [None req-46da7c90-5916-4993-8268-daf134f40eee None None] Acquiring lock "singleton_lock" {{(pid=92722) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 29 11:02:46 devstack cinder-volume[92722]: DEBUG oslo_concurrency.lockutils [None req-46da7c90-5916-4993-8268-daf134f40eee None None] Acquired lock "singleton_lock" {{(pid=92722) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 29 11:02:46 devstack cinder-volume[92722]: DEBUG oslo_concurrency.lockutils [None req-46da7c90-5916-4993-8268-daf134f40eee None None] Releasing lock "singleton_lock" {{(pid=92722) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 29 11:02:46 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] Stop services. {{(pid=92722) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 29 11:02:46 devstack cinder-volume[92722]: DEBUG oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] Killing children. {{(pid=92722) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 29 11:02:46 devstack cinder-volume[92722]: INFO oslo_service.backend._eventlet.service [None req-46da7c90-5916-4993-8268-daf134f40eee None None] Waiting on 1 children to exit Jun 29 11:02:48 devstack cinder-volume[92941]: DEBUG dbcounter [-] [92941] Writing DB stats cinder:SELECT=3 {{(pid=92941) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:02:50 devstack cinder-volume[92941]: DEBUG dbcounter [-] [92941] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=92941) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:02:51 devstack cinder-volume[92941]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jun 29 11:02:52 devstack cinder-volume[92941]: DEBUG oslo_concurrency.lockutils [None req-46da7c90-5916-4993-8268-daf134f40eee None None] Acquiring lock "singleton_lock" {{(pid=92941) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 29 11:02:52 devstack cinder-volume[92941]: DEBUG oslo_concurrency.lockutils [None req-46da7c90-5916-4993-8268-daf134f40eee None None] Acquired lock "singleton_lock" {{(pid=92941) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 29 11:02:52 devstack cinder-volume[92941]: DEBUG oslo_concurrency.lockutils [None req-46da7c90-5916-4993-8268-daf134f40eee None None] Releasing lock "singleton_lock" {{(pid=92941) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 29 11:02:52 devstack cinder-volume[92941]: WARNING amqp [None req-46da7c90-5916-4993-8268-daf134f40eee None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 29 11:02:52 devstack cinder-volume[92941]: WARNING amqp [None req-46da7c90-5916-4993-8268-daf134f40eee None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 29 11:02:52 devstack cinder-volume[93260]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 29 11:02:52 devstack cinder-volume[93260]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 29 11:02:52 devstack cinder-volume[93260]: we strongly recommend against using it for new projects. Jun 29 11:02:52 devstack cinder-volume[93260]: If you are already using Eventlet, we recommend migrating to a different Jun 29 11:02:52 devstack cinder-volume[93260]: framework. For more detail see Jun 29 11:02:52 devstack cinder-volume[93260]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 29 11:02:52 devstack cinder-volume[93260]: import eventlet # noqa Jun 29 11:02:55 devstack cinder-volume[93260]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93260) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 29 11:02:55 devstack cinder-volume[93260]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93260) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 29 11:02:55 devstack cinder-volume[93260]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93260) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 29 11:02:56 devstack cinder-volume[93260]: INFO dbcounter [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] Registered counter for database cinder Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_db.sqlalchemy.engines [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93260) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG dbcounter [-] [93260] Writer thread running {{(pid=93260) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 29 11:02:56 devstack cinder-volume[93260]: INFO cinder.rpc [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 29 11:02:56 devstack cinder-volume[93260]: INFO cinder.rpc [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_db.sqlalchemy.engines [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93260) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 11:02:56 devstack cinder-volume[93260]: INFO cinder.volume.manager [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] Determined volume DB was empty at startup. Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG cinder.volume.manager [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93260) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 29 11:02:56 devstack cinder-volume[93260]: WARNING stevedore.named [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 29 11:02:56 devstack cinder-volume[93260]: WARNING castellan.key_manager [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 29 11:02:56 devstack cinder-volume[93260]: WARNING cinder.keymgr.conf_key_mgr [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 29 11:02:56 devstack cinder-volume[93260]: INFO cinder.volume.manager [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_db.sqlalchemy.engines [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93260) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 11:02:56 devstack cinder-volume[93260]: INFO oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] Starting 1 workers Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] Started child 93497 {{(pid=93260) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] Full set of CONF: {{(pid=93260) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] ******************************************************************************** {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] Configuration options gathered from: {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] ================================================================================ {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] allow_availability_zone_fallback = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] allow_compression_on_image_upload = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] allowed_direct_url_schemes = [] {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] api_rate_limit = True {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] auth_strategy = keystone {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_availability_zone = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93497]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_host = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_name = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_stats_polling_interval = 60 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backup_api_class = cinder.backup.api.API {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backup_name_template = backup-%s {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backup_use_same_host = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backup_use_temp_snapshot = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] chap_password = **** {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] chap_username = {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cinder_internal_tenant_project_id = 22657837261943fbad774e0412afcd14 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cinder_internal_tenant_user_id = b20a8df0f6e0446d95fe541f8e74edf0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cluster = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] compression_format = gzip {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] compute_api_class = cinder.compute.nova.API {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] config_dir = [] {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] config_source = [] {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] control_exchange = openstack {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] debug = True {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] default_availability_zone = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] default_group_type = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] default_volume_type = QuobyteHD {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] disk_geometry = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] driver_client_cert = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] driver_client_cert_key = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] driver_data_namespace = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] driver_ssl_cert_path = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] driver_ssl_cert_verify = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] driver_use_ssl = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] enable_new_services = True {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] enable_unsupported_driver = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] enabled_backends = ['QuobyteHD'] {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] enforce_multipath_for_image_xfer = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] filter_function = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] glance_api_insecure = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] glance_api_servers = ['http://192.168.122.103/image'] {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] glance_api_ssl_compression = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] glance_ca_certificates_file = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] glance_catalog_info = image:glance:publicURL {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] glance_certfile = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] glance_keyfile = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] glance_num_retries = 3 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] glance_request_timeout = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] goodness_function = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] graceful_shutdown_timeout = 5 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] group_api_class = cinder.group.api.API {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] host = devstack {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] image_compress_on_upload = True {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] image_conversion_address_space_limit = 1 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] image_conversion_cpu_limit = 60 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] image_conversion_disable = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] image_upload_use_cinder_backend = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] image_upload_use_internal_tenant = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] image_volume_cache_enabled = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] image_volume_cache_max_count = 0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] image_volume_cache_max_size_gb = 0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] init_host_max_objects_retrieval = 0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] instance_format = [instance: %(uuid)s] {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] iscsi_target_flags = {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] iscsi_write_cache = on {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] iser_helper = tgtadm {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] iser_ip_address = 192.168.122.103 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] iser_port = 3260 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] log_color = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] log_config_append = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] log_dir = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] log_file = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] log_options = True {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] log_rotate_interval = 1 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] log_rotate_interval_type = days {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] log_rotation_type = none {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] max_age = 0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] max_logfile_count = 30 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] max_logfile_size_mb = 200 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:56 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] max_over_subscription_ratio = 20.0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] message_reap_interval = 86400 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] message_ttl = 2592000 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] migration_create_volume_timeout_secs = 300 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] monkey_patch = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] monkey_patch_modules = [] {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] my_ip = 192.168.122.103 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] no_snapshot_gb_quota = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] num_iser_scan_tries = 3 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] num_shell_tries = 3 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] num_volume_device_scan_tries = 3 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] nvmeof_conn_info_version = 1 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] nvmet_ns_id = 10 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] nvmet_port_id = 1 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] osapi_max_limit = 1000 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] osapi_volume_ext_list = [] {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] osapi_volume_listen = 0.0.0.0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] osapi_volume_listen_port = 8776 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] osapi_volume_use_ssl = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] osapi_volume_workers = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] per_volume_size_limit = -1 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] periodic_fuzzy_delay = 60 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] periodic_interval = 60 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] project_id_regex = [0-9a-f\-]+ {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Starting volume driver QuobyteDriver (1.1.14) Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] public_endpoint = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] publish_errors = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] quota_backup_gigabytes = 1000 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] quota_backups = 10 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93497) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] quota_gigabytes = 1000 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] quota_groups = 10 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] quota_snapshots = 10 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] quota_volumes = 10 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] rate_limit_burst = 0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] rate_limit_except_level = CRITICAL {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] rate_limit_interval = 0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] reinit_driver_count = 3 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] replication_device = **** {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] report_discard_supported = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] report_interval = 120 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] reservation_clean_interval = 86400 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] reservation_expire = 86400 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] reserved_image_namespaces = [] {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] reserved_percentage = 0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] rpc_response_timeout = 120 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] run_external_periodic_tasks = True {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] scst_target_driver = iscsi {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] scst_target_iqn_name = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] service_down_time = 720 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] shell_completion = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] snapshot_name_template = snapshot-%s {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] split_loggers = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] state_path = /opt/stack/data/cinder {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] storage_availability_zone = nova {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] storage_protocol = iSCSI {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] syslog_log_facility = LOG_USER {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] target_helper = lioadm {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] target_ip_address = 192.168.122.103 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] target_port = 3260 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] target_protocol = iscsi {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] target_secondary_ip_addresses = [] {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] trace_flags = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] transfer_api_class = cinder.transfer.api.API {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] transport_url = **** {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] until_refresh = 0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] use_chap_auth = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] use_default_quota_class = True {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] use_journal = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] use_json = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] use_multipath_for_image_xfer = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] use_stderr = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] use_syslog = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] verify_glance_signatures = enabled {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] volume_api_class = cinder.volume.api.API {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] volume_backend_name = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] volume_clear = zero {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] volume_clear_ionice = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] volume_clear_size = 0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] volume_copy_bps_limit = 0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] volume_dd_blocksize = 1M {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] volume_name_template = volume-%s {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] volume_service_inithost_offload = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] volume_usage_audit_period = month {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] zoning_mode = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_concurrency.disable_process_locking = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.auth_section = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.auth_type = password {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.auth_version = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.cache = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.certfile = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.delay_auth_decision = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.http_connect_timeout = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.include_service_catalog = True {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.insecure = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.interface = public {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.keyfile = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.memcache_password = {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.memcache_username = {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.region_name = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.service_token_roles_required = True {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.service_type = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.token_cache_time = 300 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.103/identity {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.backend = dogpile.cache.null {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.backend_argument = **** {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.backend_expiration_time = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.config_prefix = cache.oslo {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.debug_cache_backend = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.enable_retry_client = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.enable_socket_keepalive = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.enabled = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.expiration_time = 600 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.hashclient_retry_attempts = 2 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.memcache_dead_retry = 300 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.memcache_pool_maxsize = 10 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.memcache_sasl_enabled = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.password = **** {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.proxies = [] {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.redis_db = 0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.redis_sentinel_service_name = mymaster {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.redis_server = localhost:6379 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.retry_attempts = 2 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.retry_delay = 0.0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.socket_keepalive_count = 1 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.socket_keepalive_idle = 1 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.socket_keepalive_interval = 1 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.socket_timeout = 1.0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.tls_allowed_ciphers = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.tls_cafile = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.tls_certfile = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.tls_enabled = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.tls_keyfile = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cache.username = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] coordination.backend_url = **** {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] database.asyncio_connection = **** {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] database.asyncio_slave_connection = **** {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] database.backend = sqlalchemy {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] database.connection = **** {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] database.connection_debug = 0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] database.connection_parameters = {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] database.connection_recycle_time = 3600 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] database.connection_trace = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] database.db_inc_retry_interval = True {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] database.db_max_retries = 20 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] database.db_max_retry_interval = 10 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] database.db_retry_interval = 1 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] database.max_overflow = 50 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] database.max_pool_size = 5 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] database.max_retries = 10 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] database.mysql_wsrep_sync_wait = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] database.pool_timeout = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] database.retry_interval = 10 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] database.slave_connection = **** {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] database.sqlite_synchronous = True {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] database.synchronous_reader = True {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] database.use_db_reconnect = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] profiler.connection_string = messaging:// {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] profiler.enabled = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] profiler.es_doc_type = notification {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] profiler.es_scroll_size = 10000 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] profiler.es_scroll_time = 2m {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] profiler.filter_error_trace = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] profiler.hmac_keys = **** {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] profiler.sentinel_service_name = mymaster {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] profiler.socket_timeout = 0.1 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] profiler.trace_requests = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] profiler.trace_sqlalchemy = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] profiler_jaeger.process_tags = {} {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] profiler_jaeger.service_name_prefix = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] profiler_otlp.service_name_prefix = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_policy.enforce_new_defaults = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: WARNING oslo_config.cfg [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_policy.enforce_scope = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_policy.policy_default_rule = default {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_policy.policy_file = policy.yaml {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_policy.remote_timeout = 60.0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] privsep_osbrick.group = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] privsep_osbrick.helper_command = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] privsep_osbrick.user = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cinder_sys_admin.group = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cinder_sys_admin.helper_command = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] cinder_sys_admin.user = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] service_user.auth_section = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] service_user.auth_type = password {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] service_user.cafile = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] service_user.certfile = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] service_user.collect_timing = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] service_user.insecure = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] service_user.keyfile = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] service_user.send_service_user_token = True {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] service_user.split_loggers = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] service_user.timeout = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] glance.auth_section = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] glance.auth_type = password {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] glance.certfile = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] glance.collect_timing = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] glance.insecure = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] glance.keyfile = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] glance.region_name = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] glance.split_loggers = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] glance.timeout = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.backend_availability_zone = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.chap_password = **** {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.chap_username = {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.disk_geometry = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.driver_client_cert = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.driver_client_cert_key = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.driver_data_namespace = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.driver_use_ssl = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.enable_unsupported_driver = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.extra_capabilities = {} {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.filter_function = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.goodness_function = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.iscsi_target_flags = {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.iscsi_write_cache = on {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.iser_helper = tgtadm {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.iser_ip_address = 192.168.122.103 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.iser_port = 3260 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.nas_host = {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.nas_login = admin {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.nas_mount_options = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.nas_password = **** {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.nas_private_key = {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.nas_share_path = {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.nas_ssh_port = 22 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.num_shell_tries = 3 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93497) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.quobyte [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.nvmet_port_id = 1 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.quobyte [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.quobyte_client_cfg = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.quobyte_volume_url = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Running cmd (subprocess): mount.quobyte {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.replication_device = **** {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.report_discard_supported = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.reserved_percentage = 0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.scst_target_driver = iscsi {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.scst_target_iqn_name = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.storage_protocol = iSCSI {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.target_helper = tgtadm {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.target_ip_address = 192.168.122.103 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.target_port = 3260 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.target_protocol = iscsi {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.trace_flags = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.unique_fqdn_network = True {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.use_chap_auth = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.volume_backend_name = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.volume_clear = zero {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.volume_clear_ionice = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.volume_clear_size = 0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_reports.file_event_handler = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_reports.log_dir = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.backend_availability_zone = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.backend_host = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.chap_password = **** {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.chap_username = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.chiscsi_conf = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.disk_geometry = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.driver_client_cert = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.driver_client_cert_key = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.driver_data_namespace = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.driver_use_ssl = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.extra_capabilities = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.filter_function = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.goodness_function = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.iscsi_target_flags = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.iscsi_write_cache = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.iser_helper = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.iser_ip_address = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.iser_port = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.iser_target_prefix = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.nas_host = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.nas_login = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.nas_mount_options = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.nas_password = **** {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.nas_private_key = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.nas_share_path = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.nas_ssh_port = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.num_shell_tries = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.nvmet_ns_id = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.nvmet_port_id = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.replication_device = **** {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.report_discard_supported = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.reserved_percentage = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.scst_target_driver = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.storage_protocol = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.target_helper = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.target_ip_address = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.target_port = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.target_prefix = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.target_protocol = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.trace_flags = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.unique_fqdn_network = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.use_chap_auth = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.volume_clear = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.volume_clear_ionice = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.volume_clear_size = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] QuobyteHD.volumes_dir = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.ssl = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.ssl_version = {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_notifications.driver = [] {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_notifications.retry = -1 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] oslo_messaging_notifications.transport_url = **** {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] key_manager.fixed_key = **** {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] barbican.barbican_api_version = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] barbican.barbican_endpoint = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] barbican.barbican_endpoint_type = public {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] barbican.barbican_region_name = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] barbican.cafile = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] barbican.certfile = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] barbican.collect_timing = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] barbican.insecure = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] barbican.keyfile = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] barbican.number_of_retries = 60 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] barbican.retry_delay = 1 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] barbican.send_service_user_token = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] barbican.split_loggers = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] barbican.timeout = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] barbican.verify_ssl = True {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] barbican.verify_ssl_path = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] barbican_service_user.auth_section = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] barbican_service_user.auth_type = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] barbican_service_user.cafile = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] barbican_service_user.certfile = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] barbican_service_user.collect_timing = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] barbican_service_user.insecure = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] barbican_service_user.keyfile = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] barbican_service_user.split_loggers = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] barbican_service_user.timeout = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] vault.approle_role_id = **** {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] vault.approle_secret_id = **** {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] vault.kv_mountpoint = secret {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] vault.kv_path = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] vault.kv_version = 2 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] vault.namespace = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] vault.root_token_id = **** {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] vault.ssl_ca_crt_file = None {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] vault.timeout = 60.0 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] vault.use_ssl = False {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 11:02:57 devstack cinder-volume[93260]: DEBUG oslo_service.backend._eventlet.service [None req-812a4032-addc-4591-9653-7ae16b4b0a2a None None] ******************************************************************************** {{(pid=93260) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 29 11:02:57 devstack quobyte-client[93498]: Reading configuration file: /etc/quobyte/client.cfg Jun 29 11:02:57 devstack quobyte-client[93498]: Invalid parameters found, error: missing mount point. Jun 29 11:02:57 devstack quobyte-client[93498]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 29 11:02:57 devstack quobyte-client[93498]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 29 11:02:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] CMD "mount.quobyte" returned: 1 in 0.082s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:02:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:02:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:02:57 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:02:57 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:02:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:02:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:02:57 devstack sudo[93499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:02:57 devstack sudo[93499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:02:58 devstack sudo[93499]: pam_unix(sudo:session): session closed for user root Jun 29 11:02:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.825s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:02:58 devstack cinder-volume[93497]: INFO cinder.volume.driver [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Driver hasn't implemented _init_vendor_properties() Jun 29 11:02:58 devstack cinder-volume[93497]: DEBUG cinder.volume.driver [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4758987426758, 'free_capacity_gb': 1775.4758987426758, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93497) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 29 11:02:58 devstack cinder-volume[93497]: DEBUG oslo_db.sqlalchemy.engines [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93497) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 11:02:58 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writer thread running {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 29 11:02:58 devstack cinder-volume[93497]: DEBUG cinder.db.api [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Building query based on filter {{(pid=93497) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 29 11:02:58 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93497) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 29 11:02:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:02:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:02:58 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:02:58 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:02:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:02:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:02:58 devstack cinder-volume[93497]: INFO cinder.keymgr.migration [None req-4500adc5-5c9b-4b24-839f-5820dc54ab6c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 29 11:02:58 devstack sudo[93571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:02:58 devstack sudo[93571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:02:58 devstack sudo[93571]: pam_unix(sudo:session): session closed for user root Jun 29 11:02:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.690s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:02:58 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:02:58 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Driver initialization completed successfully. Jun 29 11:02:58 devstack cinder-volume[93497]: INFO cinder.manager [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Initiating service 3 cleanup Jun 29 11:02:58 devstack cinder-volume[93497]: INFO cinder.manager [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Service 3 cleanup completed. Jun 29 11:02:58 devstack cinder-volume[93497]: DEBUG cinder.service [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Creating RPC server for service cinder-volume {{(pid=93497) start /opt/stack/cinder/cinder/service.py:231}} Jun 29 11:02:58 devstack cinder-volume[93497]: DEBUG cinder.service [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93497) start /opt/stack/cinder/cinder/service.py:237}} Jun 29 11:02:59 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 29 11:02:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:02:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:02:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:02:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:02:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:02:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:02:59 devstack sudo[93622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:02:59 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:02:59 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root Jun 29 11:02:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.874s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:02:59 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-f6842c7e-5c8d-4824-a663-81a394aefdbd None None] Driver post RPC initialization completed successfully. Jun 29 11:03:06 devstack cinder-volume[93260]: DEBUG dbcounter [-] [93260] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93260) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:03:07 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager._thread_info {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:03:07 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread count: 6 {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 11:03:07 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread info: [<_MainThread(MainThread, started 131117520400512)>, , , , , ] {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 11:03:08 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:03:09 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=3 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:03:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5b9a4c33-fb81-4955-a8d6-d2f74613d352 tempest-BackendsCapabilitiesAdminTestsJSON-218632909 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4758987426758, 'free_capacity_gb': 1775.4758987426758, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93497) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 29 11:03:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-de3eb3a8-e6bf-416e-abe2-72e168769b54 tempest-BackendsCapabilitiesAdminTestsJSON-218632909 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4758987426758, 'free_capacity_gb': 1775.4758987426758, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93497) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 29 11:03:54 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-809dbb64-38a4-4361-906a-a3bff91a8a5e tempest-GroupSnapshotsTest-523122668 None] Group tempest-GroupSnapshotsTest-Group-642648028: creating Jun 29 11:03:54 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-809dbb64-38a4-4361-906a-a3bff91a8a5e tempest-GroupSnapshotsTest-523122668 None] Group tempest-GroupSnapshotsTest-Group-642648028: created successfully Jun 29 11:03:54 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-809dbb64-38a4-4361-906a-a3bff91a8a5e tempest-GroupSnapshotsTest-523122668 None] Create group completed successfully. Jun 29 11:03:55 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:03:55 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] Flow 'volume_create_manager' (a619df2c-8176-44d2-9863-a301f066b5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:03:55 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd0927e8-609a-4f71-9112-3b385e1531a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:03:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd0927e8-609a-4f71-9112-3b385e1531a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-495143357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95c3b80a-b8d1-462c-ae10-6c242af55e74,host='devstack@QuobyteHD#QuobyteHD',id=691da919-333c-4486-94e1-10ed006e1250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5b3c3c5cebb46bf80f77dbc496a0554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:03:56Z,use_quota=True,user_id='aa6e626aaa324576abd51b49dae94c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94879c2e-ffbe-42d6-9720-da5fe65ebd56),volume_type_id=94879c2e-ffbe-42d6-9720-da5fe65ebd56)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:03:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0362ee17-a059-4625-a7d1-699a1510ba5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:03:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0362ee17-a059-4625-a7d1-699a1510ba5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:03:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f3c4b1-1395-4064-a0ae-e438d18793c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:03:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f3c4b1-1395-4064-a0ae-e438d18793c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '691da919-333c-4486-94e1-10ed006e1250', 'volume_name': 'volume-691da919-333c-4486-94e1-10ed006e1250', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:03:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad3d031e-872c-49c6-a884-6b81c42a18c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:03:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad3d031e-872c-49c6-a884-6b81c42a18c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:03:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13c25691-0223-4fd0-8ba2-31c257cc34ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:03:56 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] Volume 691da919-333c-4486-94e1-10ed006e1250: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-691da919-333c-4486-94e1-10ed006e1250', 'volume_size': 1} Jun 29 11:03:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:03:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:03:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=95c3b80a-b8d1-462c-ae10-6c242af55e74,created_at=2026-06-29T09:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-495143357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95c3b80a-b8d1-462c-ae10-6c242af55e74,host='devstack@QuobyteHD#QuobyteHD',id=691da919-333c-4486-94e1-10ed006e1250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5b3c3c5cebb46bf80f77dbc496a0554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:03:56Z,use_quota=True,user_id='aa6e626aaa324576abd51b49dae94c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94879c2e-ffbe-42d6-9720-da5fe65ebd56),volume_type_id=94879c2e-ffbe-42d6-9720-da5fe65ebd56)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:03:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] Creating volume 691da919-333c-4486-94e1-10ed006e1250 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:03:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:03:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:03:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:03:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:03:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:03:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:03:56 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:03:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:03:56 devstack sudo[93889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250 1073741824 Jun 29 11:03:56 devstack sudo[93889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:03:57 devstack sudo[93889]: pam_unix(sudo:session): session closed for user root Jun 29 11:03:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250 1073741824" returned: 0 in 1.384s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:03:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:03:57 devstack sudo[94209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250 Jun 29 11:03:57 devstack sudo[94209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:03:58 devstack sudo[94209]: pam_unix(sudo:session): session closed for user root Jun 29 11:03:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250" returned: 0 in 1.107s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:03:58 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] <== create_volume: return (2588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:03:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.591s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:03:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13c25691-0223-4fd0-8ba2-31c257cc34ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-691da919-333c-4486-94e1-10ed006e1250', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:03:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96da2b5b-3e3a-49bf-b6fc-4dbeaa1bdde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:03:58 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] Volume volume-691da919-333c-4486-94e1-10ed006e1250 (691da919-333c-4486-94e1-10ed006e1250): created successfully Jun 29 11:03:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96da2b5b-3e3a-49bf-b6fc-4dbeaa1bdde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:03:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] Flow 'volume_create_manager' (a619df2c-8176-44d2-9863-a301f066b5ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:03:58 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-758971eb-0e4d-4587-b5cf-b19c4db62f27 tempest-GroupSnapshotsTest-523122668 None] Created volume successfully. Jun 29 11:04:00 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-5b227924-a62a-4a05-83a9-18045462aec9 tempest-GroupSnapshotsTest-523122668 None] GroupSnapshot 6c04dec6-e357-467a-bc92-c97ea27ae30d: creating. Jun 29 11:04:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5b227924-a62a-4a05-83a9-18045462aec9 tempest-GroupSnapshotsTest-523122668 None] Group snapshot 6c04dec6-e357-467a-bc92-c97ea27ae30d: creating. {{(pid=93497) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 29 11:04:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5b227924-a62a-4a05-83a9-18045462aec9 tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:04:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5b227924-a62a-4a05-83a9-18045462aec9 tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:04:00 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-5b227924-a62a-4a05-83a9-18045462aec9 tempest-GroupSnapshotsTest-523122668 None] Creating offline snapshot 68bd28c0-0145-488a-81b4-236952dafb2b of volume 691da919-333c-4486-94e1-10ed006e1250 {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:04:00 devstack cinder-volume[93497]: INFO oslo.privsep.daemon [None req-5b227924-a62a-4a05-83a9-18045462aec9 tempest-GroupSnapshotsTest-523122668 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpeiule60s/privsep.sock'] Jun 29 11:04:00 devstack sudo[94215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpeiule60s/privsep.sock Jun 29 11:04:00 devstack sudo[94215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:01 devstack cinder-volume[93497]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 29 11:04:01 devstack cinder-volume[93497]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 29 11:04:01 devstack cinder-volume[93497]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 29 11:04:01 devstack cinder-volume[93497]: WARNING oslo.privsep.daemon [-] privsep log: Jun 29 11:04:01 devstack cinder-volume[93497]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 29 11:04:01 devstack cinder-volume[93497]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 29 11:04:01 devstack cinder-volume[93497]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 29 11:04:01 devstack cinder-volume[93497]: WARNING oslo.privsep.daemon [-] privsep log: Jun 29 11:04:01 devstack cinder-volume[93497]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 29 11:04:02 devstack cinder-volume[93497]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 29 11:04:02 devstack cinder-volume[93497]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 29 11:04:02 devstack cinder-volume[93497]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 29 11:04:02 devstack cinder-volume[93497]: WARNING oslo.privsep.daemon [-] privsep log: Jun 29 11:04:02 devstack cinder-volume[93497]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 29 11:04:02 devstack cinder-volume[93497]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 29 11:04:02 devstack cinder-volume[93497]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 29 11:04:02 devstack cinder-volume[93497]: WARNING oslo.privsep.daemon [-] privsep log: Jun 29 11:04:02 devstack cinder-volume[93497]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 29 11:04:03 devstack sudo[94215]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:03 devstack cinder-volume[93497]: INFO oslo.privsep.daemon [None req-5b227924-a62a-4a05-83a9-18045462aec9 tempest-GroupSnapshotsTest-523122668 None] Spawned new privsep daemon via rootwrap Jun 29 11:04:03 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [None req-5b227924-a62a-4a05-83a9-18045462aec9 tempest-GroupSnapshotsTest-523122668 None] Accepted privsep connection to /tmp/tmpeiule60s/privsep.sock {{(pid=93497) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jun 29 11:04:03 devstack cinder-volume[93497]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 29 11:04:03 devstack cinder-volume[93497]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 29 11:04:03 devstack cinder-volume[93497]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 29 11:04:03 devstack cinder-volume[93497]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 94221 Jun 29 11:04:03 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c247ee9-b620-4b93-babb-0b76b480e165]: (2,) {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:04:03 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6097e769-b90f-4ffa-8e90-bf381944888a]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:04:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5b227924-a62a-4a05-83a9-18045462aec9 tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:03 devstack sudo[94225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250 Jun 29 11:04:03 devstack sudo[94225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:04 devstack sudo[94225]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5b227924-a62a-4a05-83a9-18045462aec9 tempest-GroupSnapshotsTest-523122668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250" returned: 0 in 0.973s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5b227924-a62a-4a05-83a9-18045462aec9 tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250.68bd28c0-0145-488a-81b4-236952dafb2b 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:04 devstack sudo[94234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250.68bd28c0-0145-488a-81b4-236952dafb2b 1G Jun 29 11:04:04 devstack sudo[94234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:05 devstack sudo[94234]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5b227924-a62a-4a05-83a9-18045462aec9 tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250.68bd28c0-0145-488a-81b4-236952dafb2b 1G" returned: 0 in 1.360s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5b227924-a62a-4a05-83a9-18045462aec9 tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-691da919-333c-4486-94e1-10ed006e1250 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250.68bd28c0-0145-488a-81b4-236952dafb2b {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:05 devstack sudo[94250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-691da919-333c-4486-94e1-10ed006e1250 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250.68bd28c0-0145-488a-81b4-236952dafb2b Jun 29 11:04:05 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:07 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5b227924-a62a-4a05-83a9-18045462aec9 tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-691da919-333c-4486-94e1-10ed006e1250 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250.68bd28c0-0145-488a-81b4-236952dafb2b" returned: 0 in 1.515s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:07 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-5b227924-a62a-4a05-83a9-18045462aec9 tempest-GroupSnapshotsTest-523122668 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250.68bd28c0-0145-488a-81b4-236952dafb2b is being set with open permissions: ugo+rw: NotImplementedError Jun 29 11:04:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5b227924-a62a-4a05-83a9-18045462aec9 tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250.68bd28c0-0145-488a-81b4-236952dafb2b {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:07 devstack sudo[94301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250.68bd28c0-0145-488a-81b4-236952dafb2b Jun 29 11:04:07 devstack sudo[94301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:07 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:04:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:04:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:04:07 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:04:07 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:04:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:04:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:08 devstack sudo[94303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:04:08 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:08 devstack sudo[94301]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5b227924-a62a-4a05-83a9-18045462aec9 tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250.68bd28c0-0145-488a-81b4-236952dafb2b" returned: 0 in 1.653s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5b227924-a62a-4a05-83a9-18045462aec9 tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:08 devstack sudo[94307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250.info Jun 29 11:04:08 devstack sudo[94307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:09 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.299s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:09 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:04:09 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager._thread_info {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:04:09 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread count: 8 {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 11:04:09 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread info: [<_MainThread(MainThread, started 131117520400512)>, , , , , , , ] {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 11:04:09 devstack sudo[94307]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5b227924-a62a-4a05-83a9-18045462aec9 tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250.info" returned: 0 in 1.085s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:09 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-5b227924-a62a-4a05-83a9-18045462aec9 tempest-GroupSnapshotsTest-523122668 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250.info is being set with open permissions: ugo+rw: NotImplementedError Jun 29 11:04:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5b227924-a62a-4a05-83a9-18045462aec9 tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:09 devstack sudo[94316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250.info Jun 29 11:04:09 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:11 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5b227924-a62a-4a05-83a9-18045462aec9 tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250.info" returned: 0 in 2.061s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5b227924-a62a-4a05-83a9-18045462aec9 tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 11.267s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:04:12 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-5b227924-a62a-4a05-83a9-18045462aec9 tempest-GroupSnapshotsTest-523122668 None] group_snapshot 6c04dec6-e357-467a-bc92-c97ea27ae30d: created successfully Jun 29 11:04:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:04:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:04:15 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "cinder-quobyte-68bd28c0-0145-488a-81b4-236952dafb2b-cefad3f8-d3a7-48ab-83bc-383809f6571d" by "_create_volume_from_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:04:15 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Lock "cinder-quobyte-68bd28c0-0145-488a-81b4-236952dafb2b-cefad3f8-d3a7-48ab-83bc-383809f6571d" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:04:15 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Creating volume cefad3f8-d3a7-48ab-83bc-383809f6571d from snapshot 68bd28c0-0145-488a-81b4-236952dafb2b {{(pid=93497) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 29 11:04:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:04:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:04:15 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:04:15 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:04:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:04:15 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:04:15 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "cinder-quobyte-cefad3f8-d3a7-48ab-83bc-383809f6571d" by "_copy_volume_from_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:04:15 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Lock "cinder-quobyte-cefad3f8-d3a7-48ab-83bc-383809f6571d" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:04:15 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] snapshot: 68bd28c0-0145-488a-81b4-236952dafb2b, volume: cefad3f8-d3a7-48ab-83bc-383809f6571d, {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 11:04:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:04:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:04:15 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:04:15 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:04:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:04:16 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b165b0-78be-4755-9ff8-8590f68cfb33]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:04:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250.68bd28c0-0145-488a-81b4-236952dafb2b {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:16 devstack sudo[94351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250.68bd28c0-0145-488a-81b4-236952dafb2b Jun 29 11:04:16 devstack sudo[94351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:18 devstack sudo[94351]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250.68bd28c0-0145-488a-81b4-236952dafb2b" returned: 0 in 2.405s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:18 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-691da919-333c-4486-94e1-10ed006e1250(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:04:18 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250 {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 11:04:18 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Creating direct copy from snapshot {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 11:04:18 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dce9c76-ba50-4280-a5d6-e577400c077d]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:04:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:18 devstack sudo[94381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250 Jun 29 11:04:18 devstack sudo[94381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:19 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:04:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] Flow 'volume_create_manager' (bfad39ac-6df3-4fb6-a3a4-53e2c32c4028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:04:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d9a397-6837-4862-b4bd-6930ab84694c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:04:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d9a397-6837-4862-b4bd-6930ab84694c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1155464705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=968347d0-0cc7-4c03-8120-52076355af74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='765ee191d6214ebc9cde0567a1fc479c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:04:19Z,use_quota=True,user_id='67b4e397eea443379a6d37dd51c9b078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:04:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2814b0b-fa95-479f-a2b8-f50817524172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:04:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2814b0b-fa95-479f-a2b8-f50817524172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:04:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588c8d12-3681-427e-8c94-dcfb775376c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:04:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (588c8d12-3681-427e-8c94-dcfb775376c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '968347d0-0cc7-4c03-8120-52076355af74', 'volume_name': 'volume-968347d0-0cc7-4c03-8120-52076355af74', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:04:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab41ffed-da61-491e-ba07-407dd1ed13a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:04:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab41ffed-da61-491e-ba07-407dd1ed13a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:04:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e7da1c-af3e-4859-b123-b91fcc914f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:04:19 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] Volume 968347d0-0cc7-4c03-8120-52076355af74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-968347d0-0cc7-4c03-8120-52076355af74', 'volume_size': 1} Jun 29 11:04:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:04:19 devstack sudo[94381]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250" returned: 0 in 1.500s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:20 devstack cinder-volume[93497]: DEBUG cinder.utils [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Path /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cefad3f8-d3a7-48ab-83bc-383809f6571d not found in is_blk_device check {{(pid=93497) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 11:04:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cefad3f8-d3a7-48ab-83bc-383809f6571d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:20 devstack sudo[94388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cefad3f8-d3a7-48ab-83bc-383809f6571d Jun 29 11:04:20 devstack sudo[94388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:29 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=10,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:04:29 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=16,cinder:UPDATE=6,cinder:INSERT=2 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:04:29 devstack sudo[94388]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cefad3f8-d3a7-48ab-83bc-383809f6571d" returned: 0 in 9.839s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:29 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[df00022e-b61f-4445-91c4-02c0ae6e1492]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:04:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:30 devstack sudo[94462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250 Jun 29 11:04:30 devstack sudo[94462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:31 devstack sudo[94462]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250" returned: 0 in 1.503s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:31 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Image conversion details: src /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250, size 1024.00 MB, duration 9.84 sec, destination /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cefad3f8-d3a7-48ab-83bc-383809f6571d {{(pid=93497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 11:04:31 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Converted 1024.00 MB image at 104.06 MB/s Jun 29 11:04:31 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cefad3f8-d3a7-48ab-83bc-383809f6571d is being set with open permissions: ugo+rw: NotImplementedError Jun 29 11:04:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cefad3f8-d3a7-48ab-83bc-383809f6571d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:31 devstack sudo[94477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cefad3f8-d3a7-48ab-83bc-383809f6571d Jun 29 11:04:31 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:32 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cefad3f8-d3a7-48ab-83bc-383809f6571d" returned: 0 in 1.023s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:32 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Lock "cinder-quobyte-cefad3f8-d3a7-48ab-83bc-383809f6571d" released by "_copy_volume_from_snapshot" :: held 16.542s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:04:32 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Lock "cinder-quobyte-68bd28c0-0145-488a-81b4-236952dafb2b-cefad3f8-d3a7-48ab-83bc-383809f6571d" released by "_create_volume_from_snapshot" :: held 16.609s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:04:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 16.650s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:04:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.644s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:04:32 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1155464705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=968347d0-0cc7-4c03-8120-52076355af74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='765ee191d6214ebc9cde0567a1fc479c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:04:19Z,use_quota=True,user_id='67b4e397eea443379a6d37dd51c9b078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:04:32 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] Creating volume 968347d0-0cc7-4c03-8120-52076355af74 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:04:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:04:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:04:32 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:04:32 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:04:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:04:32 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:04:32 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:04:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-968347d0-0cc7-4c03-8120-52076355af74 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:32 devstack sudo[94481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-968347d0-0cc7-4c03-8120-52076355af74 1073741824 Jun 29 11:04:32 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:32 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-1a9981a0-ccb7-41da-8ff8-48d0b3c79c9c tempest-GroupSnapshotsTest-523122668 None] Create group from source-snapshot-6c04dec6-e357-467a-bc92-c97ea27ae30d completed successfully. Jun 29 11:04:34 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-968347d0-0cc7-4c03-8120-52076355af74 1073741824" returned: 0 in 1.823s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-968347d0-0cc7-4c03-8120-52076355af74 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:34 devstack sudo[94495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-968347d0-0cc7-4c03-8120-52076355af74 Jun 29 11:04:34 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:35 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-38b3ef23-b4ae-4113-a90b-ee9fc552a320 tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "cinder-quobyte-cefad3f8-d3a7-48ab-83bc-383809f6571d" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:04:35 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-38b3ef23-b4ae-4113-a90b-ee9fc552a320 tempest-GroupSnapshotsTest-523122668 None] Lock "cinder-quobyte-cefad3f8-d3a7-48ab-83bc-383809f6571d" acquired by "delete_volume" :: waited 0.045s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:04:35 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9791e06-1894-429a-8af6-6868dd83805e]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:04:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-38b3ef23-b4ae-4113-a90b-ee9fc552a320 tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cefad3f8-d3a7-48ab-83bc-383809f6571d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:35 devstack sudo[94497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cefad3f8-d3a7-48ab-83bc-383809f6571d Jun 29 11:04:35 devstack sudo[94497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:35 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-968347d0-0cc7-4c03-8120-52076355af74" returned: 0 in 1.232s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:35 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] <== create_volume: return (3196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:04:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.201s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:04:35 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e7da1c-af3e-4859-b123-b91fcc914f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-968347d0-0cc7-4c03-8120-52076355af74', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:04:35 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (280d34d4-a7ea-4a5d-8804-25697c1875fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:04:35 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] Volume volume-968347d0-0cc7-4c03-8120-52076355af74 (968347d0-0cc7-4c03-8120-52076355af74): created successfully Jun 29 11:04:35 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (280d34d4-a7ea-4a5d-8804-25697c1875fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:04:35 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] Flow 'volume_create_manager' (bfad39ac-6df3-4fb6-a3a4-53e2c32c4028) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:04:35 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-43cf34bf-95ca-4a68-a00f-ce34f079cfed tempest-DeleteServersTestJSON-502433164 None] Created volume successfully. Jun 29 11:04:36 devstack sudo[94497]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-38b3ef23-b4ae-4113-a90b-ee9fc552a320 tempest-GroupSnapshotsTest-523122668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cefad3f8-d3a7-48ab-83bc-383809f6571d" returned: 0 in 1.329s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-38b3ef23-b4ae-4113-a90b-ee9fc552a320 tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cefad3f8-d3a7-48ab-83bc-383809f6571d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:36 devstack sudo[94505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cefad3f8-d3a7-48ab-83bc-383809f6571d Jun 29 11:04:36 devstack sudo[94505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:37 devstack sudo[94505]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-38b3ef23-b4ae-4113-a90b-ee9fc552a320 tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cefad3f8-d3a7-48ab-83bc-383809f6571d" returned: 0 in 0.882s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:37 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-38b3ef23-b4ae-4113-a90b-ee9fc552a320 tempest-GroupSnapshotsTest-523122668 None] Lock "cinder-quobyte-cefad3f8-d3a7-48ab-83bc-383809f6571d" released by "delete_volume" :: held 2.286s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:04:37 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-38b3ef23-b4ae-4113-a90b-ee9fc552a320 tempest-GroupSnapshotsTest-523122668 None] Created reservations ['2e2c471d-e2ec-4c15-b29e-19b7f0f8a71d'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:04:37 devstack cinder-volume[93497]: WARNING cinder.quota [None req-38b3ef23-b4ae-4113-a90b-ee9fc552a320 tempest-GroupSnapshotsTest-523122668 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2010649462 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2010649462, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:04:37 devstack cinder-volume[93497]: WARNING cinder.quota [None req-38b3ef23-b4ae-4113-a90b-ee9fc552a320 tempest-GroupSnapshotsTest-523122668 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2010649462 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2010649462, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:04:37 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-38b3ef23-b4ae-4113-a90b-ee9fc552a320 tempest-GroupSnapshotsTest-523122668 None] Created reservations ['e900ffd4-0a09-4a67-838c-ff40624acbcf', 'e1f336ad-34e1-467a-a4a7-d3d2ba3ec95d', '54b81a2a-e96a-436d-962d-cadcd4fbd3ab', '4aa05c4e-0f4c-4767-bf43-7c1035a57e06'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:04:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-38b3ef23-b4ae-4113-a90b-ee9fc552a320 tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:04:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-38b3ef23-b4ae-4113-a90b-ee9fc552a320 tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:04:38 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-38b3ef23-b4ae-4113-a90b-ee9fc552a320 tempest-GroupSnapshotsTest-523122668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:04:38 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-38b3ef23-b4ae-4113-a90b-ee9fc552a320 tempest-GroupSnapshotsTest-523122668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:04:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-38b3ef23-b4ae-4113-a90b-ee9fc552a320 tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:04:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-38b3ef23-b4ae-4113-a90b-ee9fc552a320 tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:38 devstack sudo[94512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:04:38 devstack sudo[94512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:39 devstack sudo[94512]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-38b3ef23-b4ae-4113-a90b-ee9fc552a320 tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.030s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:39 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-38b3ef23-b4ae-4113-a90b-ee9fc552a320 tempest-GroupSnapshotsTest-523122668 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:04:39 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-38b3ef23-b4ae-4113-a90b-ee9fc552a320 tempest-GroupSnapshotsTest-523122668 None] Delete group completed successfully. Jun 29 11:04:39 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-29eab413-53fc-4b78-bc4f-c39522bb2571 tempest-GroupSnapshotsTest-523122668 None] group_snapshot 6c04dec6-e357-467a-bc92-c97ea27ae30d: deleting Jun 29 11:04:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-29eab413-53fc-4b78-bc4f-c39522bb2571 tempest-GroupSnapshotsTest-523122668 None] group_snapshot 6c04dec6-e357-467a-bc92-c97ea27ae30d: deleting {{(pid=93497) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 29 11:04:39 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-29eab413-53fc-4b78-bc4f-c39522bb2571 tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "cinder-quobyte-691da919-333c-4486-94e1-10ed006e1250" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:04:39 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-29eab413-53fc-4b78-bc4f-c39522bb2571 tempest-GroupSnapshotsTest-523122668 None] Lock "cinder-quobyte-691da919-333c-4486-94e1-10ed006e1250" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:04:39 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-29eab413-53fc-4b78-bc4f-c39522bb2571 tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "cinder-quobyte-68bd28c0-0145-488a-81b4-236952dafb2b" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:04:39 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-29eab413-53fc-4b78-bc4f-c39522bb2571 tempest-GroupSnapshotsTest-523122668 None] Lock "cinder-quobyte-68bd28c0-0145-488a-81b4-236952dafb2b" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:04:39 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-29eab413-53fc-4b78-bc4f-c39522bb2571 tempest-GroupSnapshotsTest-523122668 None] Deleting offline snapshot 68bd28c0-0145-488a-81b4-236952dafb2b of volume 691da919-333c-4486-94e1-10ed006e1250 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:04:39 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-29eab413-53fc-4b78-bc4f-c39522bb2571 tempest-GroupSnapshotsTest-523122668 None] snapshot_file for this snap is: volume-691da919-333c-4486-94e1-10ed006e1250.68bd28c0-0145-488a-81b4-236952dafb2b {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:04:39 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1329a259-bc91-4972-84b5-2880d7a9bf3d]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:04:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-29eab413-53fc-4b78-bc4f-c39522bb2571 tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250.68bd28c0-0145-488a-81b4-236952dafb2b {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:39 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250.68bd28c0-0145-488a-81b4-236952dafb2b Jun 29 11:04:39 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:40 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-29eab413-53fc-4b78-bc4f-c39522bb2571 tempest-GroupSnapshotsTest-523122668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250.68bd28c0-0145-488a-81b4-236952dafb2b" returned: 0 in 1.328s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:40 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-29eab413-53fc-4b78-bc4f-c39522bb2571 tempest-GroupSnapshotsTest-523122668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-691da919-333c-4486-94e1-10ed006e1250(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:04:41 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e3555d-2f30-4ff0-af16-ec11ef2b71f5]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:04:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-29eab413-53fc-4b78-bc4f-c39522bb2571 tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:41 devstack sudo[94577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250 Jun 29 11:04:41 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:42 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-29eab413-53fc-4b78-bc4f-c39522bb2571 tempest-GroupSnapshotsTest-523122668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250" returned: 0 in 1.844s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-29eab413-53fc-4b78-bc4f-c39522bb2571 tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250.68bd28c0-0145-488a-81b4-236952dafb2b {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:42 devstack sudo[94651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250.68bd28c0-0145-488a-81b4-236952dafb2b Jun 29 11:04:42 devstack sudo[94651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:44 devstack cinder-volume[93497]: WARNING py.warnings [req-e23a14de-3a24-42d4-b09d-32f84080c2ab req-ad4d6242-0ba8-400b-819e-0bc0efa8dab7 tempest-DeleteServersTestJSON-502433164 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jun 29 11:04:44 devstack cinder-volume[93497]: .first() Jun 29 11:04:44 devstack cinder-volume[93497]: Jun 29 11:04:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-e23a14de-3a24-42d4-b09d-32f84080c2ab req-ad4d6242-0ba8-400b-819e-0bc0efa8dab7 tempest-DeleteServersTestJSON-502433164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:04:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-e23a14de-3a24-42d4-b09d-32f84080c2ab req-ad4d6242-0ba8-400b-819e-0bc0efa8dab7 tempest-DeleteServersTestJSON-502433164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:04:44 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1aa4e0-1f14-4611-8854-9d0d41420aaf]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:04:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-e23a14de-3a24-42d4-b09d-32f84080c2ab req-ad4d6242-0ba8-400b-819e-0bc0efa8dab7 tempest-DeleteServersTestJSON-502433164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-968347d0-0cc7-4c03-8120-52076355af74 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:44 devstack sudo[94667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-968347d0-0cc7-4c03-8120-52076355af74 Jun 29 11:04:44 devstack sudo[94667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:44 devstack sudo[94651]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-29eab413-53fc-4b78-bc4f-c39522bb2571 tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250.68bd28c0-0145-488a-81b4-236952dafb2b" returned: 0 in 1.940s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-29eab413-53fc-4b78-bc4f-c39522bb2571 tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250.68bd28c0-0145-488a-81b4-236952dafb2b {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:44 devstack sudo[94669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250.68bd28c0-0145-488a-81b4-236952dafb2b Jun 29 11:04:44 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:45 devstack sudo[94667]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-e23a14de-3a24-42d4-b09d-32f84080c2ab req-ad4d6242-0ba8-400b-819e-0bc0efa8dab7 tempest-DeleteServersTestJSON-502433164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-968347d0-0cc7-4c03-8120-52076355af74" returned: 0 in 1.321s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-e23a14de-3a24-42d4-b09d-32f84080c2ab req-ad4d6242-0ba8-400b-819e-0bc0efa8dab7 tempest-DeleteServersTestJSON-502433164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.380s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:04:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-e23a14de-3a24-42d4-b09d-32f84080c2ab req-ad4d6242-0ba8-400b-819e-0bc0efa8dab7 tempest-DeleteServersTestJSON-502433164 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3', 'name': 'volume-968347d0-0cc7-4c03-8120-52076355af74', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2650bc67-b3ad-4362-a16b-3fc793c139ff', 'enforce_multipath': True} {{(pid=93497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 11:04:45 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-e23a14de-3a24-42d4-b09d-32f84080c2ab req-ad4d6242-0ba8-400b-819e-0bc0efa8dab7 tempest-DeleteServersTestJSON-502433164 None] attachment_update completed successfully. Jun 29 11:04:46 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-29eab413-53fc-4b78-bc4f-c39522bb2571 tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250.68bd28c0-0145-488a-81b4-236952dafb2b" returned: 0 in 1.346s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:46 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-29eab413-53fc-4b78-bc4f-c39522bb2571 tempest-GroupSnapshotsTest-523122668 None] Lock "cinder-quobyte-68bd28c0-0145-488a-81b4-236952dafb2b" released by "_delete_snapshot" :: held 6.727s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:04:46 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-29eab413-53fc-4b78-bc4f-c39522bb2571 tempest-GroupSnapshotsTest-523122668 None] Lock "cinder-quobyte-691da919-333c-4486-94e1-10ed006e1250" released by "delete_snapshot" :: held 6.784s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:04:46 devstack cinder-volume[93497]: WARNING cinder.quota [None req-29eab413-53fc-4b78-bc4f-c39522bb2571 tempest-GroupSnapshotsTest-523122668 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2010649462 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2010649462, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:04:46 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-29eab413-53fc-4b78-bc4f-c39522bb2571 tempest-GroupSnapshotsTest-523122668 None] Created reservations ['373f8745-284a-48e7-8933-bfd63a73f9d5', 'f8a7a290-fbb1-4153-936e-b558b060dda8', 'c9833d5e-5231-4868-a31e-053a28373f8e', 'fd8ff079-0af7-4cb2-9d52-df662c57220e'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:04:46 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-29eab413-53fc-4b78-bc4f-c39522bb2571 tempest-GroupSnapshotsTest-523122668 None] group_snapshot 6c04dec6-e357-467a-bc92-c97ea27ae30d: deleted successfully Jun 29 11:04:47 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8a946053-b768-49fe-8fa8-defc89f8cda4 tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "cinder-quobyte-691da919-333c-4486-94e1-10ed006e1250" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:04:47 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8a946053-b768-49fe-8fa8-defc89f8cda4 tempest-GroupSnapshotsTest-523122668 None] Lock "cinder-quobyte-691da919-333c-4486-94e1-10ed006e1250" acquired by "delete_volume" :: waited 0.042s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:04:47 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f6c94d-29c6-4d6f-9872-c530363cd43e]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:04:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8a946053-b768-49fe-8fa8-defc89f8cda4 tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:47 devstack sudo[94747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250 Jun 29 11:04:47 devstack sudo[94747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:47 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:04:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] Flow 'volume_create_manager' (5f6ed079-1297-467f-bda9-351be9c35a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:04:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (629d6793-9b71-4eee-8a7f-a774b20a7fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:04:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (629d6793-9b71-4eee-8a7f-a774b20a7fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1174725157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407cc8e7-0231-45f1-a32e-88dd8a711f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='671340f995914de8a3f95cb3e5597ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:04:48Z,use_quota=True,user_id='82a7bdf55c714432bc233809936ac7eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:04:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221472da-2ea7-4257-9b49-d6e9d4024ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:04:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221472da-2ea7-4257-9b49-d6e9d4024ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:04:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f384e3-1c83-4aba-828b-cca42a2f73db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:04:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f384e3-1c83-4aba-828b-cca42a2f73db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '407cc8e7-0231-45f1-a32e-88dd8a711f1d', 'volume_name': 'volume-407cc8e7-0231-45f1-a32e-88dd8a711f1d', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:04:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (512df5b2-fe14-4eb8-8d9c-4589e2ab80ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:04:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (512df5b2-fe14-4eb8-8d9c-4589e2ab80ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:04:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (311274cf-1a5d-408b-9c87-45af0b4a0b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:04:47 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] Volume 407cc8e7-0231-45f1-a32e-88dd8a711f1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-407cc8e7-0231-45f1-a32e-88dd8a711f1d', 'volume_size': 1} Jun 29 11:04:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:04:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:04:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1174725157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407cc8e7-0231-45f1-a32e-88dd8a711f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='671340f995914de8a3f95cb3e5597ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:04:48Z,use_quota=True,user_id='82a7bdf55c714432bc233809936ac7eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:04:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] Creating volume 407cc8e7-0231-45f1-a32e-88dd8a711f1d {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:04:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:04:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:04:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:04:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:04:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:04:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:04:47 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:04:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-407cc8e7-0231-45f1-a32e-88dd8a711f1d 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:48 devstack sudo[95069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-407cc8e7-0231-45f1-a32e-88dd8a711f1d 1073741824 Jun 29 11:04:48 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:49 devstack sudo[94747]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8a946053-b768-49fe-8fa8-defc89f8cda4 tempest-GroupSnapshotsTest-523122668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250" returned: 0 in 1.590s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8a946053-b768-49fe-8fa8-defc89f8cda4 tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:49 devstack sudo[95078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250 Jun 29 11:04:49 devstack sudo[95078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:49 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-407cc8e7-0231-45f1-a32e-88dd8a711f1d 1073741824" returned: 0 in 1.556s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-407cc8e7-0231-45f1-a32e-88dd8a711f1d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:49 devstack sudo[95082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-407cc8e7-0231-45f1-a32e-88dd8a711f1d Jun 29 11:04:49 devstack sudo[95082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:50 devstack sudo[95078]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8a946053-b768-49fe-8fa8-defc89f8cda4 tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-691da919-333c-4486-94e1-10ed006e1250" returned: 0 in 1.134s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:50 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8a946053-b768-49fe-8fa8-defc89f8cda4 tempest-GroupSnapshotsTest-523122668 None] Lock "cinder-quobyte-691da919-333c-4486-94e1-10ed006e1250" released by "delete_volume" :: held 2.881s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:04:50 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-8a946053-b768-49fe-8fa8-defc89f8cda4 tempest-GroupSnapshotsTest-523122668 None] Created reservations ['8708af1a-3ab8-487b-8921-bce4ba0f84ae'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:04:50 devstack cinder-volume[93497]: WARNING cinder.db.api [None req-8a946053-b768-49fe-8fa8-defc89f8cda4 tempest-GroupSnapshotsTest-523122668 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2010649462'] Jun 29 11:04:50 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-8a946053-b768-49fe-8fa8-defc89f8cda4 tempest-GroupSnapshotsTest-523122668 None] Created reservations ['5a7989df-a394-4010-a6fb-5483f39b4fb2', '4250a1cc-2498-40b1-ad0c-177077700326', '2f0f0276-7b39-4f26-ba87-f6e392a34c6c', '8e97322a-47d2-402b-8f74-087d97d3a68a'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:04:50 devstack sudo[95082]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-407cc8e7-0231-45f1-a32e-88dd8a711f1d" returned: 0 in 1.002s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] <== create_volume: return (2636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:04:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.640s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:04:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (311274cf-1a5d-408b-9c87-45af0b4a0b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-407cc8e7-0231-45f1-a32e-88dd8a711f1d', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:04:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11f3214-1d1c-4b92-a598-dce3bc9991b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:04:50 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] Volume volume-407cc8e7-0231-45f1-a32e-88dd8a711f1d (407cc8e7-0231-45f1-a32e-88dd8a711f1d): created successfully Jun 29 11:04:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11f3214-1d1c-4b92-a598-dce3bc9991b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:04:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] Flow 'volume_create_manager' (5f6ed079-1297-467f-bda9-351be9c35a73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:04:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8a946053-b768-49fe-8fa8-defc89f8cda4 tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:04:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8a946053-b768-49fe-8fa8-defc89f8cda4 tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:04:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8a946053-b768-49fe-8fa8-defc89f8cda4 tempest-GroupSnapshotsTest-523122668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:04:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8a946053-b768-49fe-8fa8-defc89f8cda4 tempest-GroupSnapshotsTest-523122668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:04:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8a946053-b768-49fe-8fa8-defc89f8cda4 tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:04:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8a946053-b768-49fe-8fa8-defc89f8cda4 tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:50 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-c8afff74-7c17-4bbf-b7c2-7352e3786bdb tempest-VolumesAdminNegativeTest-141869447 None] Created volume successfully. Jun 29 11:04:50 devstack sudo[95087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:04:50 devstack sudo[95087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:51 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b1e668cb-ffca-422e-b91d-c75dab74c650 tempest-VolumesAdminNegativeTest-141869447 None] Acquiring lock "cinder-407cc8e7-0231-45f1-a32e-88dd8a711f1d-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:04:51 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b1e668cb-ffca-422e-b91d-c75dab74c650 tempest-VolumesAdminNegativeTest-141869447 None] Lock "cinder-407cc8e7-0231-45f1-a32e-88dd8a711f1d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:04:51 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b1e668cb-ffca-422e-b91d-c75dab74c650 tempest-VolumesAdminNegativeTest-141869447 None] Acquiring lock "cinder-quobyte-407cc8e7-0231-45f1-a32e-88dd8a711f1d" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:04:51 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b1e668cb-ffca-422e-b91d-c75dab74c650 tempest-VolumesAdminNegativeTest-141869447 None] Lock "cinder-quobyte-407cc8e7-0231-45f1-a32e-88dd8a711f1d" acquired by "delete_volume" :: waited 0.045s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:04:52 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b3fe3a-d693-49db-84c4-a260fb83abe6]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:04:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b1e668cb-ffca-422e-b91d-c75dab74c650 tempest-VolumesAdminNegativeTest-141869447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-407cc8e7-0231-45f1-a32e-88dd8a711f1d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:52 devstack sudo[95087]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8a946053-b768-49fe-8fa8-defc89f8cda4 tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.322s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:52 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-8a946053-b768-49fe-8fa8-defc89f8cda4 tempest-GroupSnapshotsTest-523122668 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:04:52 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-8a946053-b768-49fe-8fa8-defc89f8cda4 tempest-GroupSnapshotsTest-523122668 None] Delete group completed successfully. Jun 29 11:04:52 devstack sudo[95091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-407cc8e7-0231-45f1-a32e-88dd8a711f1d Jun 29 11:04:52 devstack sudo[95091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:52 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-52e0488a-12b1-4e94-b0d1-46ca9524a935 tempest-GroupSnapshotsTest-523122668 None] Group tempest-GroupSnapshotsTest-Group-973068942: creating Jun 29 11:04:52 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-52e0488a-12b1-4e94-b0d1-46ca9524a935 tempest-GroupSnapshotsTest-523122668 None] Group tempest-GroupSnapshotsTest-Group-973068942: created successfully Jun 29 11:04:52 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-52e0488a-12b1-4e94-b0d1-46ca9524a935 tempest-GroupSnapshotsTest-523122668 None] Create group completed successfully. Jun 29 11:04:53 devstack sudo[95091]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b1e668cb-ffca-422e-b91d-c75dab74c650 tempest-VolumesAdminNegativeTest-141869447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-407cc8e7-0231-45f1-a32e-88dd8a711f1d" returned: 0 in 1.425s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b1e668cb-ffca-422e-b91d-c75dab74c650 tempest-VolumesAdminNegativeTest-141869447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-407cc8e7-0231-45f1-a32e-88dd8a711f1d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:53 devstack sudo[95097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-407cc8e7-0231-45f1-a32e-88dd8a711f1d Jun 29 11:04:53 devstack sudo[95097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:54 devstack sudo[95097]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b1e668cb-ffca-422e-b91d-c75dab74c650 tempest-VolumesAdminNegativeTest-141869447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-407cc8e7-0231-45f1-a32e-88dd8a711f1d" returned: 0 in 1.324s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:54 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b1e668cb-ffca-422e-b91d-c75dab74c650 tempest-VolumesAdminNegativeTest-141869447 None] Lock "cinder-quobyte-407cc8e7-0231-45f1-a32e-88dd8a711f1d" released by "delete_volume" :: held 2.884s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:04:55 devstack cinder-volume[93497]: WARNING cinder.quota [None req-b1e668cb-ffca-422e-b91d-c75dab74c650 tempest-VolumesAdminNegativeTest-141869447 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:04:55 devstack cinder-volume[93497]: WARNING cinder.quota [None req-b1e668cb-ffca-422e-b91d-c75dab74c650 tempest-VolumesAdminNegativeTest-141869447 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:04:55 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-b1e668cb-ffca-422e-b91d-c75dab74c650 tempest-VolumesAdminNegativeTest-141869447 None] Created reservations ['c838963d-faae-455b-b2e4-e60a1d9b95a6', 'b628497f-e561-4aa6-8cf5-0c2aedd3ddf8', '1f5863d5-4bdc-45c7-898d-fe74e4efb529', '98c01c71-93b6-4ab0-ba64-a3fff6f4ebcd'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:04:55 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:04:55 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] Flow 'volume_create_manager' (1a24245d-ee90-42fb-8b3a-18ed848513e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:04:55 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdfa99f4-d455-4f6f-b829-270b9cf49b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:04:55 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdfa99f4-d455-4f6f-b829-270b9cf49b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-591257184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3d369404-cb42-4252-930f-08ea52c89038,host='devstack@QuobyteHD#QuobyteHD',id=7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5b3c3c5cebb46bf80f77dbc496a0554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:04:55Z,use_quota=True,user_id='aa6e626aaa324576abd51b49dae94c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe08c720-6096-4f99-ad07-192bbeb78842),volume_type_id=fe08c720-6096-4f99-ad07-192bbeb78842)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:04:55 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da201cfe-f2ac-491e-afec-c6cc8b2a16e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:04:55 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da201cfe-f2ac-491e-afec-c6cc8b2a16e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:04:55 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab41898-f2c0-4de0-9576-e2448ecc16c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:04:55 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab41898-f2c0-4de0-9576-e2448ecc16c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d', 'volume_name': 'volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:04:55 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (603db9b7-cedd-4c98-b2c7-9ee31a882fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:04:55 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (603db9b7-cedd-4c98-b2c7-9ee31a882fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:04:55 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47ce9af-cdd4-4f37-b1d8-bb3323925bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:04:55 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] Volume 7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d', 'volume_size': 1} Jun 29 11:04:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:04:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:04:55 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3d369404-cb42-4252-930f-08ea52c89038,created_at=2026-06-29T09:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-591257184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3d369404-cb42-4252-930f-08ea52c89038,host='devstack@QuobyteHD#QuobyteHD',id=7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5b3c3c5cebb46bf80f77dbc496a0554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:04:55Z,use_quota=True,user_id='aa6e626aaa324576abd51b49dae94c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe08c720-6096-4f99-ad07-192bbeb78842),volume_type_id=fe08c720-6096-4f99-ad07-192bbeb78842)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:04:55 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] Creating volume 7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:04:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:04:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:04:55 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:04:55 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:04:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:04:55 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:04:55 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:04:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:55 devstack sudo[95166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d 1073741824 Jun 29 11:04:55 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b1e668cb-ffca-422e-b91d-c75dab74c650 tempest-VolumesAdminNegativeTest-141869447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:04:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b1e668cb-ffca-422e-b91d-c75dab74c650 tempest-VolumesAdminNegativeTest-141869447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:04:55 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b1e668cb-ffca-422e-b91d-c75dab74c650 tempest-VolumesAdminNegativeTest-141869447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:04:55 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b1e668cb-ffca-422e-b91d-c75dab74c650 tempest-VolumesAdminNegativeTest-141869447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:04:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b1e668cb-ffca-422e-b91d-c75dab74c650 tempest-VolumesAdminNegativeTest-141869447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:04:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b1e668cb-ffca-422e-b91d-c75dab74c650 tempest-VolumesAdminNegativeTest-141869447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:56 devstack sudo[95170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:04:56 devstack sudo[95170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:57 devstack sudo[95170]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b1e668cb-ffca-422e-b91d-c75dab74c650 tempest-VolumesAdminNegativeTest-141869447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.651s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:57 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-b1e668cb-ffca-422e-b91d-c75dab74c650 tempest-VolumesAdminNegativeTest-141869447 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:04:57 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-b1e668cb-ffca-422e-b91d-c75dab74c650 tempest-VolumesAdminNegativeTest-141869447 None] Deleted volume successfully. Jun 29 11:04:57 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b1e668cb-ffca-422e-b91d-c75dab74c650 tempest-VolumesAdminNegativeTest-141869447 None] Lock "cinder-407cc8e7-0231-45f1-a32e-88dd8a711f1d-delete_volume" released by "delete_volume" :: held 5.809s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:04:57 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d 1073741824" returned: 0 in 2.008s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:04:57 devstack sudo[95242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d Jun 29 11:04:57 devstack sudo[95242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:04:59 devstack sudo[95242]: pam_unix(sudo:session): session closed for user root Jun 29 11:04:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d" returned: 0 in 1.279s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:04:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] <== create_volume: return (3408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:04:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.417s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:04:59 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-a53b519b-b234-49ac-9a36-eb67744989fc req-ee2d71e7-054b-4cdb-a236-b8fb0c6a1de3 tempest-DeleteServersTestJSON-502433164 None] Terminate volume connection completed successfully. Jun 29 11:04:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-a53b519b-b234-49ac-9a36-eb67744989fc req-ee2d71e7-054b-4cdb-a236-b8fb0c6a1de3 tempest-DeleteServersTestJSON-502433164 None] Deleting attachment 2650bc67-b3ad-4362-a16b-3fc793c139ff. {{(pid=93497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 11:04:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47ce9af-cdd4-4f37-b1d8-bb3323925bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:04:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb3b2834-1bfe-48b4-870d-6fca90116270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:04:59 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] Volume volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d (7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d): created successfully Jun 29 11:04:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb3b2834-1bfe-48b4-870d-6fca90116270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:04:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] Flow 'volume_create_manager' (1a24245d-ee90-42fb-8b3a-18ed848513e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:04:59 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-aa35201e-d19c-4a6a-a364-643c103901f9 tempest-GroupSnapshotsTest-523122668 None] Created volume successfully. Jun 29 11:05:00 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:05:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] Flow 'volume_create_manager' (d9705f12-8679-4f0c-8ea2-e928668c2658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:05:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3fd5136-511a-4e5e-afc7-133c7c912e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:05:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3fd5136-511a-4e5e-afc7-133c7c912e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1306861489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3d369404-cb42-4252-930f-08ea52c89038,host='devstack@QuobyteHD#QuobyteHD',id=1ed0096f-e323-4957-b4fa-1a07ab783dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5b3c3c5cebb46bf80f77dbc496a0554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:05:00Z,use_quota=True,user_id='aa6e626aaa324576abd51b49dae94c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe08c720-6096-4f99-ad07-192bbeb78842),volume_type_id=fe08c720-6096-4f99-ad07-192bbeb78842)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:05:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6337cbe-59cf-434b-a50c-12c4b90961ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:05:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6337cbe-59cf-434b-a50c-12c4b90961ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:05:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47400e10-1eab-4dfa-9e08-6f352c75fc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:05:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47400e10-1eab-4dfa-9e08-6f352c75fc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ed0096f-e323-4957-b4fa-1a07ab783dce', 'volume_name': 'volume-1ed0096f-e323-4957-b4fa-1a07ab783dce', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:05:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db38e94e-860b-4cde-bf1e-7287fa5f1726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:05:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db38e94e-860b-4cde-bf1e-7287fa5f1726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:05:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdef8114-324c-4fae-9844-0209bbaa4ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:05:00 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] Volume 1ed0096f-e323-4957-b4fa-1a07ab783dce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ed0096f-e323-4957-b4fa-1a07ab783dce', 'volume_size': 1} Jun 29 11:05:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:05:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:05:00 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3d369404-cb42-4252-930f-08ea52c89038,created_at=2026-06-29T09:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1306861489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3d369404-cb42-4252-930f-08ea52c89038,host='devstack@QuobyteHD#QuobyteHD',id=1ed0096f-e323-4957-b4fa-1a07ab783dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5b3c3c5cebb46bf80f77dbc496a0554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:05:00Z,use_quota=True,user_id='aa6e626aaa324576abd51b49dae94c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe08c720-6096-4f99-ad07-192bbeb78842),volume_type_id=fe08c720-6096-4f99-ad07-192bbeb78842)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:05:00 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] Creating volume 1ed0096f-e323-4957-b4fa-1a07ab783dce {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:05:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:05:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:05:00 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:05:00 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:05:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:05:00 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:05:00 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:05:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:00 devstack sudo[95250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce 1073741824 Jun 29 11:05:00 devstack sudo[95250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:01 devstack sudo[95250]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce 1073741824" returned: 0 in 1.182s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:01 devstack sudo[95259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce Jun 29 11:05:01 devstack sudo[95259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:02 devstack sudo[95259]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce" returned: 0 in 0.750s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:02 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] <== create_volume: return (2030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:05:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.034s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:05:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdef8114-324c-4fae-9844-0209bbaa4ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ed0096f-e323-4957-b4fa-1a07ab783dce', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:05:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd48cdb-6898-4c31-8ccc-c1e7c0d15444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:05:02 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] Volume volume-1ed0096f-e323-4957-b4fa-1a07ab783dce (1ed0096f-e323-4957-b4fa-1a07ab783dce): created successfully Jun 29 11:05:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd48cdb-6898-4c31-8ccc-c1e7c0d15444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:05:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] Flow 'volume_create_manager' (d9705f12-8679-4f0c-8ea2-e928668c2658) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:05:02 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-10b78c16-a8e5-44a6-a7ce-269118e0435a tempest-GroupSnapshotsTest-523122668 None] Created volume successfully. Jun 29 11:05:03 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-2b4c657a-76e2-4ad8-914a-5edbf9660cb9 tempest-GroupSnapshotsTest-523122668 None] Update group completed successfully. Jun 29 11:05:04 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-a62d97dc-372f-433c-83f9-0cb556265826 tempest-GroupSnapshotsTest-523122668 None] Update group completed successfully. Jun 29 11:05:04 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ff31e1a2-1385-4747-9cce-4b8243254ef1 tempest-DeleteServersTestJSON-502433164 None] Acquiring lock "cinder-968347d0-0cc7-4c03-8120-52076355af74-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:05:04 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ff31e1a2-1385-4747-9cce-4b8243254ef1 tempest-DeleteServersTestJSON-502433164 None] Lock "cinder-968347d0-0cc7-4c03-8120-52076355af74-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:05:04 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ff31e1a2-1385-4747-9cce-4b8243254ef1 tempest-DeleteServersTestJSON-502433164 None] Acquiring lock "cinder-quobyte-968347d0-0cc7-4c03-8120-52076355af74" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:05:04 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ff31e1a2-1385-4747-9cce-4b8243254ef1 tempest-DeleteServersTestJSON-502433164 None] Lock "cinder-quobyte-968347d0-0cc7-4c03-8120-52076355af74" acquired by "delete_volume" :: waited 0.020s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:05:04 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d32869a-dd8d-44f7-9473-5b868ba269ab]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:05:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ff31e1a2-1385-4747-9cce-4b8243254ef1 tempest-DeleteServersTestJSON-502433164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-968347d0-0cc7-4c03-8120-52076355af74 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:05 devstack sudo[95262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-968347d0-0cc7-4c03-8120-52076355af74 Jun 29 11:05:05 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:05 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ff31e1a2-1385-4747-9cce-4b8243254ef1 tempest-DeleteServersTestJSON-502433164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-968347d0-0cc7-4c03-8120-52076355af74" returned: 0 in 0.842s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ff31e1a2-1385-4747-9cce-4b8243254ef1 tempest-DeleteServersTestJSON-502433164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-968347d0-0cc7-4c03-8120-52076355af74 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:05 devstack sudo[95267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-968347d0-0cc7-4c03-8120-52076355af74 Jun 29 11:05:05 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:05 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-252011e3-f77d-4faf-8d56-0bb9b6b5ef5b tempest-GroupSnapshotsTest-523122668 None] Update group completed successfully. Jun 29 11:05:06 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ff31e1a2-1385-4747-9cce-4b8243254ef1 tempest-DeleteServersTestJSON-502433164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-968347d0-0cc7-4c03-8120-52076355af74" returned: 0 in 0.694s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ff31e1a2-1385-4747-9cce-4b8243254ef1 tempest-DeleteServersTestJSON-502433164 None] Lock "cinder-quobyte-968347d0-0cc7-4c03-8120-52076355af74" released by "delete_volume" :: held 1.596s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:05:06 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-ff31e1a2-1385-4747-9cce-4b8243254ef1 tempest-DeleteServersTestJSON-502433164 None] Created reservations ['6e61d1a6-3920-4e6b-817e-7fb8b3b4ca04', 'f0486023-62ac-477a-9ca7-e98609c4b366', 'ec021cb1-5606-4335-b194-f742746e4d58', '769e8802-450d-4159-b0df-bcc86f2d9445'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:05:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ff31e1a2-1385-4747-9cce-4b8243254ef1 tempest-DeleteServersTestJSON-502433164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:05:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ff31e1a2-1385-4747-9cce-4b8243254ef1 tempest-DeleteServersTestJSON-502433164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:05:06 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ff31e1a2-1385-4747-9cce-4b8243254ef1 tempest-DeleteServersTestJSON-502433164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:05:06 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ff31e1a2-1385-4747-9cce-4b8243254ef1 tempest-DeleteServersTestJSON-502433164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:05:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ff31e1a2-1385-4747-9cce-4b8243254ef1 tempest-DeleteServersTestJSON-502433164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:05:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ff31e1a2-1385-4747-9cce-4b8243254ef1 tempest-DeleteServersTestJSON-502433164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:06 devstack sudo[95271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:05:06 devstack sudo[95271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:07 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-45e2e270-5715-4bea-b265-081bf3479807 tempest-GroupSnapshotsTest-523122668 None] Update group completed successfully. Jun 29 11:05:07 devstack sudo[95271]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ff31e1a2-1385-4747-9cce-4b8243254ef1 tempest-DeleteServersTestJSON-502433164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.028s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:07 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-ff31e1a2-1385-4747-9cce-4b8243254ef1 tempest-DeleteServersTestJSON-502433164 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:05:07 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-ff31e1a2-1385-4747-9cce-4b8243254ef1 tempest-DeleteServersTestJSON-502433164 None] Deleted volume successfully. Jun 29 11:05:07 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ff31e1a2-1385-4747-9cce-4b8243254ef1 tempest-DeleteServersTestJSON-502433164 None] Lock "cinder-968347d0-0cc7-4c03-8120-52076355af74-delete_volume" released by "delete_volume" :: held 2.918s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:05:07 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:05:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:05:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:05:07 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:05:07 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:05:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:05:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:08 devstack sudo[95274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:05:08 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:08 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.995s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:08 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:05:08 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager._thread_info {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:05:08 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread count: 8 {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 11:05:08 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread info: [<_MainThread(MainThread, started 131117520400512)>, , , , , , , ] {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 11:05:09 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] GroupSnapshot 3b01d214-9fd1-44bb-b575-3259940e1667: creating. Jun 29 11:05:09 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] Group snapshot 3b01d214-9fd1-44bb-b575-3259940e1667: creating. {{(pid=93497) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 29 11:05:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:05:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:05:09 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] Creating offline snapshot a4f6ce37-d138-41c5-b293-b9906dcc4e89 of volume 7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:05:09 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[924e246f-015e-4a75-9203-a0282c8bed24]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:05:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:09 devstack sudo[95278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d Jun 29 11:05:09 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:10 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d" returned: 0 in 0.927s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d.a4f6ce37-d138-41c5-b293-b9906dcc4e89 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:10 devstack sudo[95284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d.a4f6ce37-d138-41c5-b293-b9906dcc4e89 1G Jun 29 11:05:10 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:11 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d.a4f6ce37-d138-41c5-b293-b9906dcc4e89 1G" returned: 0 in 1.094s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d.a4f6ce37-d138-41c5-b293-b9906dcc4e89 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:11 devstack sudo[95290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d.a4f6ce37-d138-41c5-b293-b9906dcc4e89 Jun 29 11:05:11 devstack sudo[95290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:12 devstack sudo[95290]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d.a4f6ce37-d138-41c5-b293-b9906dcc4e89" returned: 0 in 0.936s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:12 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d.a4f6ce37-d138-41c5-b293-b9906dcc4e89 is being set with open permissions: ugo+rw: NotImplementedError Jun 29 11:05:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d.a4f6ce37-d138-41c5-b293-b9906dcc4e89 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:12 devstack sudo[95298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d.a4f6ce37-d138-41c5-b293-b9906dcc4e89 Jun 29 11:05:12 devstack sudo[95298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:13 devstack sudo[95298]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d.a4f6ce37-d138-41c5-b293-b9906dcc4e89" returned: 0 in 0.882s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:13 devstack sudo[95301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d.info Jun 29 11:05:13 devstack sudo[95301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:13 devstack sudo[95301]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d.info" returned: 0 in 0.812s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:13 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d.info is being set with open permissions: ugo+rw: NotImplementedError Jun 29 11:05:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:13 devstack sudo[95304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d.info Jun 29 11:05:13 devstack sudo[95304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:14 devstack sudo[95304]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d.info" returned: 0 in 0.898s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.660s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:05:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:05:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:05:14 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] Creating offline snapshot a8006cf5-0b24-42e4-9b6a-a01965d9ad4a of volume 1ed0096f-e323-4957-b4fa-1a07ab783dce {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:05:14 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0af7b3-d296-46b9-bcee-73b292ce6ad1]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:05:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:15 devstack sudo[95307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce Jun 29 11:05:15 devstack sudo[95307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:16 devstack sudo[95307]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce" returned: 0 in 1.255s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce.a8006cf5-0b24-42e4-9b6a-a01965d9ad4a 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:16 devstack sudo[95320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce.a8006cf5-0b24-42e4-9b6a-a01965d9ad4a 1G Jun 29 11:05:16 devstack sudo[95320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:17 devstack sudo[95320]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce.a8006cf5-0b24-42e4-9b6a-a01965d9ad4a 1G" returned: 0 in 1.124s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ed0096f-e323-4957-b4fa-1a07ab783dce -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce.a8006cf5-0b24-42e4-9b6a-a01965d9ad4a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:17 devstack sudo[95327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ed0096f-e323-4957-b4fa-1a07ab783dce -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce.a8006cf5-0b24-42e4-9b6a-a01965d9ad4a Jun 29 11:05:17 devstack sudo[95327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:18 devstack sudo[95327]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ed0096f-e323-4957-b4fa-1a07ab783dce -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce.a8006cf5-0b24-42e4-9b6a-a01965d9ad4a" returned: 0 in 0.908s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:18 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce.a8006cf5-0b24-42e4-9b6a-a01965d9ad4a is being set with open permissions: ugo+rw: NotImplementedError Jun 29 11:05:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce.a8006cf5-0b24-42e4-9b6a-a01965d9ad4a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:18 devstack sudo[95335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce.a8006cf5-0b24-42e4-9b6a-a01965d9ad4a Jun 29 11:05:18 devstack sudo[95335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:19 devstack sudo[95335]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce.a8006cf5-0b24-42e4-9b6a-a01965d9ad4a" returned: 0 in 0.998s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:19 devstack sudo[95339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce.info Jun 29 11:05:19 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:20 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce.info" returned: 0 in 0.887s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:20 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce.info is being set with open permissions: ugo+rw: NotImplementedError Jun 29 11:05:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:20 devstack sudo[95342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce.info Jun 29 11:05:20 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:20 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce.info" returned: 0 in 0.841s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.143s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:05:21 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-5fc94ef5-5f1c-45d3-a225-d064ecc177ee tempest-GroupSnapshotsTest-523122668 None] group_snapshot 3b01d214-9fd1-44bb-b575-3259940e1667: created successfully Jun 29 11:05:22 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] group_snapshot 3b01d214-9fd1-44bb-b575-3259940e1667: deleting Jun 29 11:05:22 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] group_snapshot 3b01d214-9fd1-44bb-b575-3259940e1667: deleting {{(pid=93497) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 29 11:05:22 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "cinder-quobyte-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:05:22 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] Lock "cinder-quobyte-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:05:22 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "cinder-quobyte-a4f6ce37-d138-41c5-b293-b9906dcc4e89" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:05:22 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] Lock "cinder-quobyte-a4f6ce37-d138-41c5-b293-b9906dcc4e89" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:05:22 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] Deleting offline snapshot a4f6ce37-d138-41c5-b293-b9906dcc4e89 of volume 7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:05:22 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] snapshot_file for this snap is: volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d.a4f6ce37-d138-41c5-b293-b9906dcc4e89 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:05:22 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c634515-4543-452e-a6f5-b4e3c11c125c]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:05:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d.a4f6ce37-d138-41c5-b293-b9906dcc4e89 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:22 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d.a4f6ce37-d138-41c5-b293-b9906dcc4e89 Jun 29 11:05:22 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:23 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d.a4f6ce37-d138-41c5-b293-b9906dcc4e89" returned: 0 in 1.031s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:23 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:05:23 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af38a16-e811-4344-ba94-feb8aa3e336a]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:05:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:23 devstack sudo[95351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d Jun 29 11:05:23 devstack sudo[95351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:24 devstack sudo[95351]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d" returned: 0 in 1.120s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d.a4f6ce37-d138-41c5-b293-b9906dcc4e89 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:24 devstack sudo[95358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d.a4f6ce37-d138-41c5-b293-b9906dcc4e89 Jun 29 11:05:24 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:25 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d.a4f6ce37-d138-41c5-b293-b9906dcc4e89" returned: 0 in 1.157s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d.a4f6ce37-d138-41c5-b293-b9906dcc4e89 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:25 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d.a4f6ce37-d138-41c5-b293-b9906dcc4e89 Jun 29 11:05:25 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:26 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d.a4f6ce37-d138-41c5-b293-b9906dcc4e89" returned: 0 in 0.829s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:26 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] Lock "cinder-quobyte-a4f6ce37-d138-41c5-b293-b9906dcc4e89" released by "_delete_snapshot" :: held 4.316s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:05:26 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] Lock "cinder-quobyte-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d" released by "delete_snapshot" :: held 4.352s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:05:26 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "cinder-quobyte-1ed0096f-e323-4957-b4fa-1a07ab783dce" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:05:26 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] Lock "cinder-quobyte-1ed0096f-e323-4957-b4fa-1a07ab783dce" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:05:26 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "cinder-quobyte-a8006cf5-0b24-42e4-9b6a-a01965d9ad4a" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:05:26 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] Lock "cinder-quobyte-a8006cf5-0b24-42e4-9b6a-a01965d9ad4a" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:05:26 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] Deleting offline snapshot a8006cf5-0b24-42e4-9b6a-a01965d9ad4a of volume 1ed0096f-e323-4957-b4fa-1a07ab783dce {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:05:26 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] snapshot_file for this snap is: volume-1ed0096f-e323-4957-b4fa-1a07ab783dce.a8006cf5-0b24-42e4-9b6a-a01965d9ad4a {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:05:26 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ab1555-d25e-4f0f-95ca-44c5b128e685]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:05:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce.a8006cf5-0b24-42e4-9b6a-a01965d9ad4a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:26 devstack sudo[95369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce.a8006cf5-0b24-42e4-9b6a-a01965d9ad4a Jun 29 11:05:26 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:28 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce.a8006cf5-0b24-42e4-9b6a-a01965d9ad4a" returned: 0 in 1.242s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:28 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ed0096f-e323-4957-b4fa-1a07ab783dce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:05:28 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb58491e-bd19-4228-a1e9-21531fec45ad]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:05:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:28 devstack sudo[95374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce Jun 29 11:05:28 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:29 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce" returned: 0 in 1.209s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce.a8006cf5-0b24-42e4-9b6a-a01965d9ad4a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:29 devstack sudo[95379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce.a8006cf5-0b24-42e4-9b6a-a01965d9ad4a Jun 29 11:05:29 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:30 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce.a8006cf5-0b24-42e4-9b6a-a01965d9ad4a" returned: 0 in 1.273s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce.a8006cf5-0b24-42e4-9b6a-a01965d9ad4a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:30 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce.a8006cf5-0b24-42e4-9b6a-a01965d9ad4a Jun 29 11:05:30 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:31 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce.a8006cf5-0b24-42e4-9b6a-a01965d9ad4a" returned: 0 in 1.026s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:31 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] Lock "cinder-quobyte-a8006cf5-0b24-42e4-9b6a-a01965d9ad4a" released by "_delete_snapshot" :: held 4.937s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:05:31 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] Lock "cinder-quobyte-1ed0096f-e323-4957-b4fa-1a07ab783dce" released by "delete_snapshot" :: held 4.988s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:05:31 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:UPDATE=62,cinder:SELECT=70,cinder:INSERT=11,cinder:DELETE=3 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:05:31 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:UPDATE=73,cinder:SELECT=69,cinder:INSERT=17,cinder:DELETE=3 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:05:31 devstack cinder-volume[93497]: WARNING cinder.quota [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1913023628 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1913023628, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:05:31 devstack cinder-volume[93497]: WARNING cinder.quota [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1913023628 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1913023628, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:05:31 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] Created reservations ['64314cbd-1b40-44da-8615-75afcd3f011a', '5a125032-523a-4465-8e72-086ced319d73', 'b5293484-3bc4-4c2a-acdd-7442369801d2', '61ee2319-5fcd-410d-b1b3-862abc493993'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:05:32 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] Created reservations ['d5a06bc5-d655-4592-9f8b-c034faa917e0', '4b697674-ee20-41a0-8814-1f1f57374ac2', '054b0d51-bacc-4074-865b-2f0ccdff7311', '124faa1f-51a4-481d-87ad-00ef21de6d34'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:05:32 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-1d42820e-d821-4190-9e8f-047cfb6ba73f tempest-GroupSnapshotsTest-523122668 None] group_snapshot 3b01d214-9fd1-44bb-b575-3259940e1667: deleted successfully Jun 29 11:05:34 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3876f840-c295-4371-952e-5f67a4f2f98a tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "cinder-quobyte-1ed0096f-e323-4957-b4fa-1a07ab783dce" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:05:34 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3876f840-c295-4371-952e-5f67a4f2f98a tempest-GroupSnapshotsTest-523122668 None] Lock "cinder-quobyte-1ed0096f-e323-4957-b4fa-1a07ab783dce" acquired by "delete_volume" :: waited 0.036s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:05:34 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[664ee1dd-5871-4c13-8cbe-a854bb22ec3f]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:05:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3876f840-c295-4371-952e-5f67a4f2f98a tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:34 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce Jun 29 11:05:34 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:35 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3876f840-c295-4371-952e-5f67a4f2f98a tempest-GroupSnapshotsTest-523122668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce" returned: 0 in 0.950s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3876f840-c295-4371-952e-5f67a4f2f98a tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:35 devstack sudo[95410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce Jun 29 11:05:35 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:36 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3876f840-c295-4371-952e-5f67a4f2f98a tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed0096f-e323-4957-b4fa-1a07ab783dce" returned: 0 in 1.109s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3876f840-c295-4371-952e-5f67a4f2f98a tempest-GroupSnapshotsTest-523122668 None] Lock "cinder-quobyte-1ed0096f-e323-4957-b4fa-1a07ab783dce" released by "delete_volume" :: held 2.182s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:05:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3876f840-c295-4371-952e-5f67a4f2f98a tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "cinder-quobyte-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:05:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3876f840-c295-4371-952e-5f67a4f2f98a tempest-GroupSnapshotsTest-523122668 None] Lock "cinder-quobyte-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d" acquired by "delete_volume" :: waited 0.023s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:05:36 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ff983f-28de-4f92-8924-d864078e0d90]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:05:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3876f840-c295-4371-952e-5f67a4f2f98a tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:36 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d Jun 29 11:05:36 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:37 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3876f840-c295-4371-952e-5f67a4f2f98a tempest-GroupSnapshotsTest-523122668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d" returned: 0 in 1.171s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3876f840-c295-4371-952e-5f67a4f2f98a tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:37 devstack sudo[95423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d Jun 29 11:05:37 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:38 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3876f840-c295-4371-952e-5f67a4f2f98a tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d" returned: 0 in 0.813s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:38 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3876f840-c295-4371-952e-5f67a4f2f98a tempest-GroupSnapshotsTest-523122668 None] Lock "cinder-quobyte-7ef2d2ff-9ab0-4641-adfa-ed9037b5b80d" released by "delete_volume" :: held 2.093s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:05:38 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-3876f840-c295-4371-952e-5f67a4f2f98a tempest-GroupSnapshotsTest-523122668 None] Created reservations ['95bb6503-9617-48c9-9fd0-dc4790a4ed25'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:05:38 devstack cinder-volume[93497]: WARNING cinder.quota [None req-3876f840-c295-4371-952e-5f67a4f2f98a tempest-GroupSnapshotsTest-523122668 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1913023628 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1913023628, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:05:38 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-3876f840-c295-4371-952e-5f67a4f2f98a tempest-GroupSnapshotsTest-523122668 None] Created reservations ['14fbbc66-ebef-4587-b1f3-d93558ed2237', '6ed85d1b-8207-4b3b-b660-0b978c12b5a5', '176fe735-0f91-4025-85a0-068e5f9e83d7', 'e1ae7345-9cbe-47f8-985d-e6a2ea871836'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:05:38 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-3876f840-c295-4371-952e-5f67a4f2f98a tempest-GroupSnapshotsTest-523122668 None] Created reservations ['51333deb-3419-4680-8c03-6e0ed971a6b4', '52cb2b5f-fb16-4975-9ab4-7b86b4a9d128', '39cace00-133a-4ec8-9a54-d622ce40d095', 'a85b9559-4990-4f74-96eb-dece6c8600c4'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:05:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3876f840-c295-4371-952e-5f67a4f2f98a tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:05:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3876f840-c295-4371-952e-5f67a4f2f98a tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:05:38 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-3876f840-c295-4371-952e-5f67a4f2f98a tempest-GroupSnapshotsTest-523122668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:05:38 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-3876f840-c295-4371-952e-5f67a4f2f98a tempest-GroupSnapshotsTest-523122668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:05:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3876f840-c295-4371-952e-5f67a4f2f98a tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:05:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3876f840-c295-4371-952e-5f67a4f2f98a tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:38 devstack sudo[95426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:05:38 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:40 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3876f840-c295-4371-952e-5f67a4f2f98a tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.112s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:40 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-3876f840-c295-4371-952e-5f67a4f2f98a tempest-GroupSnapshotsTest-523122668 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:05:40 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-3876f840-c295-4371-952e-5f67a4f2f98a tempest-GroupSnapshotsTest-523122668 None] Delete group completed successfully. Jun 29 11:05:40 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-ddf95357-78b4-4915-93a6-1c55af2bbce1 tempest-GroupSnapshotsTest-523122668 None] Group tempest-GroupSnapshotsTest-Group-2052483782: creating Jun 29 11:05:40 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-ddf95357-78b4-4915-93a6-1c55af2bbce1 tempest-GroupSnapshotsTest-523122668 None] Group tempest-GroupSnapshotsTest-Group-2052483782: created successfully Jun 29 11:05:40 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-ddf95357-78b4-4915-93a6-1c55af2bbce1 tempest-GroupSnapshotsTest-523122668 None] Create group completed successfully. Jun 29 11:05:42 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:05:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] Flow 'volume_create_manager' (5ad93931-2b3d-40ba-8b7e-68d45d5a9330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:05:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d467c18-4f1d-43a0-84cd-f8cb51a97959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:05:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d467c18-4f1d-43a0-84cd-f8cb51a97959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1270159931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cdace4fd-63ee-4bac-be05-5504114f7248,host='devstack@QuobyteHD#QuobyteHD',id=063836de-35a9-42b2-abb0-c3127c63f2da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5b3c3c5cebb46bf80f77dbc496a0554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:05:43Z,use_quota=True,user_id='aa6e626aaa324576abd51b49dae94c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fccc0dfa-84e6-4022-8d15-7fbaf3dd9e92),volume_type_id=fccc0dfa-84e6-4022-8d15-7fbaf3dd9e92)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:05:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8369d5c-e961-43db-bb0c-e436fc50f7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:05:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8369d5c-e961-43db-bb0c-e436fc50f7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:05:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b17d920-9eee-4206-84d5-0520d4892332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:05:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b17d920-9eee-4206-84d5-0520d4892332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '063836de-35a9-42b2-abb0-c3127c63f2da', 'volume_name': 'volume-063836de-35a9-42b2-abb0-c3127c63f2da', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:05:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08d3c5bd-acb6-4382-baad-f57698d874c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:05:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08d3c5bd-acb6-4382-baad-f57698d874c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:05:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08d4468-697b-45e9-a6b6-3df9c17a78a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:05:43 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] Volume 063836de-35a9-42b2-abb0-c3127c63f2da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-063836de-35a9-42b2-abb0-c3127c63f2da', 'volume_size': 1} Jun 29 11:05:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:05:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:05:43 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cdace4fd-63ee-4bac-be05-5504114f7248,created_at=2026-06-29T09:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1270159931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cdace4fd-63ee-4bac-be05-5504114f7248,host='devstack@QuobyteHD#QuobyteHD',id=063836de-35a9-42b2-abb0-c3127c63f2da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5b3c3c5cebb46bf80f77dbc496a0554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:05:43Z,use_quota=True,user_id='aa6e626aaa324576abd51b49dae94c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fccc0dfa-84e6-4022-8d15-7fbaf3dd9e92),volume_type_id=fccc0dfa-84e6-4022-8d15-7fbaf3dd9e92)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:05:43 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] Creating volume 063836de-35a9-42b2-abb0-c3127c63f2da {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:05:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:05:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:05:43 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:05:43 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:05:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:05:43 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:05:43 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:05:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:43 devstack sudo[95542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da 1073741824 Jun 29 11:05:43 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:44 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da 1073741824" returned: 0 in 1.658s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:44 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da Jun 29 11:05:44 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:46 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da" returned: 0 in 1.753s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] <== create_volume: return (3516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:05:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.520s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:05:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08d4468-697b-45e9-a6b6-3df9c17a78a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-063836de-35a9-42b2-abb0-c3127c63f2da', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:05:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b6ac77-c0f6-45db-90ba-c765c9920675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:05:46 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] Volume volume-063836de-35a9-42b2-abb0-c3127c63f2da (063836de-35a9-42b2-abb0-c3127c63f2da): created successfully Jun 29 11:05:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b6ac77-c0f6-45db-90ba-c765c9920675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:05:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] Flow 'volume_create_manager' (5ad93931-2b3d-40ba-8b7e-68d45d5a9330) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:05:46 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-ffbdb257-f75c-49ca-9a8d-015f76db6711 tempest-GroupSnapshotsTest-523122668 None] Created volume successfully. Jun 29 11:05:48 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-731b5951-e90b-4a79-b27f-f6c2f495715c tempest-GroupSnapshotsTest-523122668 None] GroupSnapshot 222e2cb4-3f9a-4019-9de8-a5be03ec273c: creating. Jun 29 11:05:48 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-731b5951-e90b-4a79-b27f-f6c2f495715c tempest-GroupSnapshotsTest-523122668 None] Group snapshot 222e2cb4-3f9a-4019-9de8-a5be03ec273c: creating. {{(pid=93497) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 29 11:05:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-731b5951-e90b-4a79-b27f-f6c2f495715c tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:05:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-731b5951-e90b-4a79-b27f-f6c2f495715c tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:05:48 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-731b5951-e90b-4a79-b27f-f6c2f495715c tempest-GroupSnapshotsTest-523122668 None] Creating offline snapshot ffaf3229-53a3-45c0-9d44-dbf628656b3c of volume 063836de-35a9-42b2-abb0-c3127c63f2da {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:05:48 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cf0b30-d689-4984-b796-62b2618248bd]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:05:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-731b5951-e90b-4a79-b27f-f6c2f495715c tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:48 devstack sudo[95573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da Jun 29 11:05:48 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:50 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-731b5951-e90b-4a79-b27f-f6c2f495715c tempest-GroupSnapshotsTest-523122668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da" returned: 0 in 1.938s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-731b5951-e90b-4a79-b27f-f6c2f495715c tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da.ffaf3229-53a3-45c0-9d44-dbf628656b3c 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:50 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da.ffaf3229-53a3-45c0-9d44-dbf628656b3c 1G Jun 29 11:05:50 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:51 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-731b5951-e90b-4a79-b27f-f6c2f495715c tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da.ffaf3229-53a3-45c0-9d44-dbf628656b3c 1G" returned: 0 in 1.638s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-731b5951-e90b-4a79-b27f-f6c2f495715c tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-063836de-35a9-42b2-abb0-c3127c63f2da -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da.ffaf3229-53a3-45c0-9d44-dbf628656b3c {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:51 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-063836de-35a9-42b2-abb0-c3127c63f2da -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da.ffaf3229-53a3-45c0-9d44-dbf628656b3c Jun 29 11:05:51 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:52 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-731b5951-e90b-4a79-b27f-f6c2f495715c tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-063836de-35a9-42b2-abb0-c3127c63f2da -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da.ffaf3229-53a3-45c0-9d44-dbf628656b3c" returned: 0 in 1.105s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:52 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-731b5951-e90b-4a79-b27f-f6c2f495715c tempest-GroupSnapshotsTest-523122668 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da.ffaf3229-53a3-45c0-9d44-dbf628656b3c is being set with open permissions: ugo+rw: NotImplementedError Jun 29 11:05:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-731b5951-e90b-4a79-b27f-f6c2f495715c tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da.ffaf3229-53a3-45c0-9d44-dbf628656b3c {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:52 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da.ffaf3229-53a3-45c0-9d44-dbf628656b3c Jun 29 11:05:52 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:53 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-731b5951-e90b-4a79-b27f-f6c2f495715c tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da.ffaf3229-53a3-45c0-9d44-dbf628656b3c" returned: 0 in 1.068s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-731b5951-e90b-4a79-b27f-f6c2f495715c tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:54 devstack sudo[95614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da.info Jun 29 11:05:54 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:55 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-731b5951-e90b-4a79-b27f-f6c2f495715c tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da.info" returned: 0 in 1.045s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:55 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-731b5951-e90b-4a79-b27f-f6c2f495715c tempest-GroupSnapshotsTest-523122668 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da.info is being set with open permissions: ugo+rw: NotImplementedError Jun 29 11:05:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-731b5951-e90b-4a79-b27f-f6c2f495715c tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:55 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da.info Jun 29 11:05:55 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:56 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-731b5951-e90b-4a79-b27f-f6c2f495715c tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da.info" returned: 0 in 0.955s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-731b5951-e90b-4a79-b27f-f6c2f495715c tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.910s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:05:56 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-731b5951-e90b-4a79-b27f-f6c2f495715c tempest-GroupSnapshotsTest-523122668 None] group_snapshot 222e2cb4-3f9a-4019-9de8-a5be03ec273c: created successfully Jun 29 11:05:57 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-d3666326-4415-451c-8aa5-7869bce02485 tempest-GroupSnapshotsTest-523122668 None] group_snapshot 222e2cb4-3f9a-4019-9de8-a5be03ec273c: deleting Jun 29 11:05:57 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d3666326-4415-451c-8aa5-7869bce02485 tempest-GroupSnapshotsTest-523122668 None] group_snapshot 222e2cb4-3f9a-4019-9de8-a5be03ec273c: deleting {{(pid=93497) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 29 11:05:57 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d3666326-4415-451c-8aa5-7869bce02485 tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "cinder-quobyte-063836de-35a9-42b2-abb0-c3127c63f2da" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:05:57 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d3666326-4415-451c-8aa5-7869bce02485 tempest-GroupSnapshotsTest-523122668 None] Lock "cinder-quobyte-063836de-35a9-42b2-abb0-c3127c63f2da" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:05:57 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d3666326-4415-451c-8aa5-7869bce02485 tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "cinder-quobyte-ffaf3229-53a3-45c0-9d44-dbf628656b3c" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:05:57 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d3666326-4415-451c-8aa5-7869bce02485 tempest-GroupSnapshotsTest-523122668 None] Lock "cinder-quobyte-ffaf3229-53a3-45c0-9d44-dbf628656b3c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:05:57 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-d3666326-4415-451c-8aa5-7869bce02485 tempest-GroupSnapshotsTest-523122668 None] Deleting offline snapshot ffaf3229-53a3-45c0-9d44-dbf628656b3c of volume 063836de-35a9-42b2-abb0-c3127c63f2da {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:05:57 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-d3666326-4415-451c-8aa5-7869bce02485 tempest-GroupSnapshotsTest-523122668 None] snapshot_file for this snap is: volume-063836de-35a9-42b2-abb0-c3127c63f2da.ffaf3229-53a3-45c0-9d44-dbf628656b3c {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:05:57 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8d670e-b7f1-4f6f-bfee-a28091c0c764]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:05:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d3666326-4415-451c-8aa5-7869bce02485 tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da.ffaf3229-53a3-45c0-9d44-dbf628656b3c {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:57 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da.ffaf3229-53a3-45c0-9d44-dbf628656b3c Jun 29 11:05:57 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d3666326-4415-451c-8aa5-7869bce02485 tempest-GroupSnapshotsTest-523122668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da.ffaf3229-53a3-45c0-9d44-dbf628656b3c" returned: 0 in 1.192s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:58 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-d3666326-4415-451c-8aa5-7869bce02485 tempest-GroupSnapshotsTest-523122668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-063836de-35a9-42b2-abb0-c3127c63f2da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:05:58 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:58 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1d2f5d-fef4-4a8c-8cc4-0445fe24e6db]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:05:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d3666326-4415-451c-8aa5-7869bce02485 tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:58 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da Jun 29 11:05:58 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:05:59 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Jun 29 11:05:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d3666326-4415-451c-8aa5-7869bce02485 tempest-GroupSnapshotsTest-523122668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da" returned: 0 in 1.063s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:05:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d3666326-4415-451c-8aa5-7869bce02485 tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da.ffaf3229-53a3-45c0-9d44-dbf628656b3c {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:05:59 devstack sudo[95652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da.ffaf3229-53a3-45c0-9d44-dbf628656b3c Jun 29 11:05:59 devstack sudo[95652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:06:00 devstack sudo[95652]: pam_unix(sudo:session): session closed for user root Jun 29 11:06:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d3666326-4415-451c-8aa5-7869bce02485 tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da.ffaf3229-53a3-45c0-9d44-dbf628656b3c" returned: 0 in 1.136s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:06:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d3666326-4415-451c-8aa5-7869bce02485 tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da.ffaf3229-53a3-45c0-9d44-dbf628656b3c {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:06:00 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da.ffaf3229-53a3-45c0-9d44-dbf628656b3c Jun 29 11:06:00 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:06:01 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Jun 29 11:06:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d3666326-4415-451c-8aa5-7869bce02485 tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da.ffaf3229-53a3-45c0-9d44-dbf628656b3c" returned: 0 in 1.082s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:06:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d3666326-4415-451c-8aa5-7869bce02485 tempest-GroupSnapshotsTest-523122668 None] Lock "cinder-quobyte-ffaf3229-53a3-45c0-9d44-dbf628656b3c" released by "_delete_snapshot" :: held 4.667s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:06:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d3666326-4415-451c-8aa5-7869bce02485 tempest-GroupSnapshotsTest-523122668 None] Lock "cinder-quobyte-063836de-35a9-42b2-abb0-c3127c63f2da" released by "delete_snapshot" :: held 4.699s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:06:02 devstack cinder-volume[93497]: WARNING cinder.quota [None req-d3666326-4415-451c-8aa5-7869bce02485 tempest-GroupSnapshotsTest-523122668 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1685777962 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1685777962, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:06:02 devstack cinder-volume[93497]: WARNING cinder.quota [None req-d3666326-4415-451c-8aa5-7869bce02485 tempest-GroupSnapshotsTest-523122668 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1685777962 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1685777962, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:06:02 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-d3666326-4415-451c-8aa5-7869bce02485 tempest-GroupSnapshotsTest-523122668 None] Created reservations ['a461bfb3-2a17-40b9-a42d-d2e16a138218', '052e57ab-b052-44ef-a257-259b393233ec', 'dd939bca-0313-4c77-9ccb-8a8b25eb1b8c', '36441f37-3817-42a4-bfec-a212e6a839c5'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:06:02 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-d3666326-4415-451c-8aa5-7869bce02485 tempest-GroupSnapshotsTest-523122668 None] group_snapshot 222e2cb4-3f9a-4019-9de8-a5be03ec273c: deleted successfully Jun 29 11:06:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8e08995e-2dbe-4b82-8a35-3a66b571ddad tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "cinder-quobyte-063836de-35a9-42b2-abb0-c3127c63f2da" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:06:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8e08995e-2dbe-4b82-8a35-3a66b571ddad tempest-GroupSnapshotsTest-523122668 None] Lock "cinder-quobyte-063836de-35a9-42b2-abb0-c3127c63f2da" acquired by "delete_volume" :: waited 0.042s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:06:03 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a52ee1a-5841-4ea6-89a1-73791a00ec52]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:06:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8e08995e-2dbe-4b82-8a35-3a66b571ddad tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:06:04 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da Jun 29 11:06:04 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:06:05 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Jun 29 11:06:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8e08995e-2dbe-4b82-8a35-3a66b571ddad tempest-GroupSnapshotsTest-523122668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da" returned: 0 in 1.228s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:06:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8e08995e-2dbe-4b82-8a35-3a66b571ddad tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:06:05 devstack sudo[95837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da Jun 29 11:06:05 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:06:06 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root Jun 29 11:06:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8e08995e-2dbe-4b82-8a35-3a66b571ddad tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-063836de-35a9-42b2-abb0-c3127c63f2da" returned: 0 in 1.652s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:06:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8e08995e-2dbe-4b82-8a35-3a66b571ddad tempest-GroupSnapshotsTest-523122668 None] Lock "cinder-quobyte-063836de-35a9-42b2-abb0-c3127c63f2da" released by "delete_volume" :: held 3.101s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:06:07 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-8e08995e-2dbe-4b82-8a35-3a66b571ddad tempest-GroupSnapshotsTest-523122668 None] Created reservations ['04b3c323-2bef-4092-91da-964c171d06ac'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:06:07 devstack cinder-volume[93497]: WARNING cinder.quota [None req-8e08995e-2dbe-4b82-8a35-3a66b571ddad tempest-GroupSnapshotsTest-523122668 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1685777962 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1685777962, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:06:07 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-8e08995e-2dbe-4b82-8a35-3a66b571ddad tempest-GroupSnapshotsTest-523122668 None] Created reservations ['d3e38d9b-4afe-40d4-8507-f228e2038d06', 'f2b62d06-5b19-4e44-b5ea-4a4de8bc0377', '8c4a0d0e-e6c6-45cb-aa12-f323c0ab13f4', 'bb566c9d-297b-42ce-b03b-bc4add24096e'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:06:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8e08995e-2dbe-4b82-8a35-3a66b571ddad tempest-GroupSnapshotsTest-523122668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:06:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8e08995e-2dbe-4b82-8a35-3a66b571ddad tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:06:07 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8e08995e-2dbe-4b82-8a35-3a66b571ddad tempest-GroupSnapshotsTest-523122668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:06:07 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8e08995e-2dbe-4b82-8a35-3a66b571ddad tempest-GroupSnapshotsTest-523122668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:06:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8e08995e-2dbe-4b82-8a35-3a66b571ddad tempest-GroupSnapshotsTest-523122668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:06:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8e08995e-2dbe-4b82-8a35-3a66b571ddad tempest-GroupSnapshotsTest-523122668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:06:07 devstack sudo[95856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:06:07 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:06:07 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:06:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:06:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:06:07 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:06:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:06:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:06:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:06:08 devstack sudo[95858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:06:08 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:06:10 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root Jun 29 11:06:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 2.079s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:06:10 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:06:10 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager._thread_info {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:06:10 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread count: 8 {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 11:06:10 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread info: [<_MainThread(MainThread, started 131117520400512)>, , , , , , , ] {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 11:06:10 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root Jun 29 11:06:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8e08995e-2dbe-4b82-8a35-3a66b571ddad tempest-GroupSnapshotsTest-523122668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 2.963s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:06:10 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-8e08995e-2dbe-4b82-8a35-3a66b571ddad tempest-GroupSnapshotsTest-523122668 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:06:10 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-8e08995e-2dbe-4b82-8a35-3a66b571ddad tempest-GroupSnapshotsTest-523122668 None] Delete group completed successfully. Jun 29 11:06:17 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:06:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] Flow 'volume_create_manager' (43079a20-c10a-481d-a62a-8468c34f8057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:06:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59aab917-b82b-41cc-8080-f517dbd58322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:06:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59aab917-b82b-41cc-8080-f517dbd58322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-242729874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8dc1235-d3ab-4dfe-9b53-65bac30367b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df639a8c6b7546f3830d960dde9a1043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:06:17Z,use_quota=True,user_id='f90a309237e242e5821ff38d2848b9b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:06:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb7f999e-bb03-466f-850c-23b28746dba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:06:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb7f999e-bb03-466f-850c-23b28746dba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:06:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (596aea0b-b167-4215-aa87-fb8907aa53e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:06:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (596aea0b-b167-4215-aa87-fb8907aa53e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8dc1235-d3ab-4dfe-9b53-65bac30367b3', 'volume_name': 'volume-c8dc1235-d3ab-4dfe-9b53-65bac30367b3', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:06:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158c322e-e548-49fa-b909-757a9fdaaa4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:06:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158c322e-e548-49fa-b909-757a9fdaaa4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:06:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6004adcc-2bc5-4de9-8789-a89678037fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:06:17 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] Volume c8dc1235-d3ab-4dfe-9b53-65bac30367b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8dc1235-d3ab-4dfe-9b53-65bac30367b3', 'volume_size': 1} Jun 29 11:06:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:06:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:06:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-242729874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8dc1235-d3ab-4dfe-9b53-65bac30367b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df639a8c6b7546f3830d960dde9a1043',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:06:17Z,use_quota=True,user_id='f90a309237e242e5821ff38d2848b9b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:06:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] Creating volume c8dc1235-d3ab-4dfe-9b53-65bac30367b3 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:06:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:06:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:06:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:06:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:06:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:06:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:06:17 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:06:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c8dc1235-d3ab-4dfe-9b53-65bac30367b3 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:06:17 devstack sudo[95874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c8dc1235-d3ab-4dfe-9b53-65bac30367b3 1073741824 Jun 29 11:06:17 devstack sudo[95874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:06:19 devstack sudo[95874]: pam_unix(sudo:session): session closed for user root Jun 29 11:06:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c8dc1235-d3ab-4dfe-9b53-65bac30367b3 1073741824" returned: 0 in 2.132s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:06:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c8dc1235-d3ab-4dfe-9b53-65bac30367b3 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:06:19 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c8dc1235-d3ab-4dfe-9b53-65bac30367b3 Jun 29 11:06:19 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:06:20 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Jun 29 11:06:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c8dc1235-d3ab-4dfe-9b53-65bac30367b3" returned: 0 in 1.218s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:06:20 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] <== create_volume: return (3481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:06:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.490s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:06:20 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6004adcc-2bc5-4de9-8789-a89678037fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8dc1235-d3ab-4dfe-9b53-65bac30367b3', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:06:20 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (717834b4-ab25-4f7c-805c-1288264405e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:06:20 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] Volume volume-c8dc1235-d3ab-4dfe-9b53-65bac30367b3 (c8dc1235-d3ab-4dfe-9b53-65bac30367b3): created successfully Jun 29 11:06:20 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (717834b4-ab25-4f7c-805c-1288264405e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:06:20 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] Flow 'volume_create_manager' (43079a20-c10a-481d-a62a-8468c34f8057) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:06:21 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-7fe5e92a-b7d9-4b73-a1bc-b0e905ae8ecf tempest-ServerActionsTestOtherA-772013197 None] Created volume successfully. Jun 29 11:06:28 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:06:28 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] Flow 'volume_create_manager' (5dcb5414-f416-4776-919b-d7322870de54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:06:28 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b473f0-910e-4a0c-9353-2cb92372e3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:06:28 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b473f0-910e-4a0c-9353-2cb92372e3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-600433847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ec9585-ac91-4b01-ae36-0a6b7d0aac72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32362e2a3b474a4aab9c34419ee75470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:06:28Z,use_quota=True,user_id='f5ee08c95520463380de1bc58037b48a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:06:28 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (472fbd48-7b71-4310-a8b4-3735fa66365e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:06:28 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (472fbd48-7b71-4310-a8b4-3735fa66365e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:06:28 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceef8c2e-4a11-40cd-93f1-2b7a99e0df9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:06:28 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceef8c2e-4a11-40cd-93f1-2b7a99e0df9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31ec9585-ac91-4b01-ae36-0a6b7d0aac72', 'volume_name': 'volume-31ec9585-ac91-4b01-ae36-0a6b7d0aac72', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:06:28 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1736a5b-4ce3-4df8-ae4a-4ac93f711db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:06:28 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1736a5b-4ce3-4df8-ae4a-4ac93f711db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:06:28 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6027823f-6908-4436-8b3d-cdd7cec8d254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:06:28 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] Volume 31ec9585-ac91-4b01-ae36-0a6b7d0aac72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31ec9585-ac91-4b01-ae36-0a6b7d0aac72', 'volume_size': 1} Jun 29 11:06:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:06:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:06:28 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-600433847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ec9585-ac91-4b01-ae36-0a6b7d0aac72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32362e2a3b474a4aab9c34419ee75470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:06:28Z,use_quota=True,user_id='f5ee08c95520463380de1bc58037b48a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:06:28 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] Creating volume 31ec9585-ac91-4b01-ae36-0a6b7d0aac72 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:06:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:06:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:06:28 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:06:28 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:06:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:06:28 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:06:28 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:06:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-31ec9585-ac91-4b01-ae36-0a6b7d0aac72 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:06:28 devstack sudo[96035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-31ec9585-ac91-4b01-ae36-0a6b7d0aac72 1073741824 Jun 29 11:06:28 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:06:30 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root Jun 29 11:06:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-31ec9585-ac91-4b01-ae36-0a6b7d0aac72 1073741824" returned: 0 in 1.378s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:06:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-31ec9585-ac91-4b01-ae36-0a6b7d0aac72 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:06:30 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-31ec9585-ac91-4b01-ae36-0a6b7d0aac72 Jun 29 11:06:30 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:06:31 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Jun 29 11:06:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-31ec9585-ac91-4b01-ae36-0a6b7d0aac72" returned: 0 in 1.140s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:06:31 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] <== create_volume: return (2582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:06:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.591s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:06:31 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6027823f-6908-4436-8b3d-cdd7cec8d254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31ec9585-ac91-4b01-ae36-0a6b7d0aac72', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:06:31 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b2d18d-0904-441d-956b-826b7112b56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:06:31 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] Volume volume-31ec9585-ac91-4b01-ae36-0a6b7d0aac72 (31ec9585-ac91-4b01-ae36-0a6b7d0aac72): created successfully Jun 29 11:06:31 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b2d18d-0904-441d-956b-826b7112b56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:06:31 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] Flow 'volume_create_manager' (5dcb5414-f416-4776-919b-d7322870de54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:06:31 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-9f523316-9f67-44fe-b9c3-7e83781d249f tempest-TaggedAttachmentsTest-735790113 None] Created volume successfully. Jun 29 11:06:36 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=48,cinder:INSERT=12,cinder:UPDATE=58,cinder:DELETE=1 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:06:36 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=56,cinder:INSERT=18,cinder:UPDATE=60,cinder:DELETE=2 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:06:36 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-348d02f0-d40c-4610-be1e-83a084ac5e31 tempest-GroupsTest-615311935 None] Group tempest-Group1-1810363565: creating Jun 29 11:06:36 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:06:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] Flow 'volume_create_manager' (936139a8-b2f2-4647-b98b-5bc4ca79c4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:06:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a85ca3c6-6149-41ff-b0eb-6339984ef5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:06:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a85ca3c6-6149-41ff-b0eb-6339984ef5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2007265028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b3a24f-7dc5-4e45-a0df-db3b8a40cf04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6a2d227ca36438f9c31cfbcc9aab7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:06:36Z,use_quota=True,user_id='c1eff39160ee42fab25eab8928384f2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:06:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540253e4-ebda-4e50-b967-7e969f1ecba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:06:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540253e4-ebda-4e50-b967-7e969f1ecba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:06:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a041cd14-7a01-45e6-876f-01400c5f95b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:06:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a041cd14-7a01-45e6-876f-01400c5f95b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4b3a24f-7dc5-4e45-a0df-db3b8a40cf04', 'volume_name': 'volume-d4b3a24f-7dc5-4e45-a0df-db3b8a40cf04', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:06:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f5b189-d28f-40a4-b7c8-f0d4e92a0a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:06:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f5b189-d28f-40a4-b7c8-f0d4e92a0a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:06:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7314236d-1ec8-4819-bd79-a1242a56ece9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:06:36 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] Volume d4b3a24f-7dc5-4e45-a0df-db3b8a40cf04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4b3a24f-7dc5-4e45-a0df-db3b8a40cf04', 'volume_size': 1} Jun 29 11:06:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:06:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:06:36 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2007265028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b3a24f-7dc5-4e45-a0df-db3b8a40cf04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6a2d227ca36438f9c31cfbcc9aab7d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:06:36Z,use_quota=True,user_id='c1eff39160ee42fab25eab8928384f2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:06:36 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] Creating volume d4b3a24f-7dc5-4e45-a0df-db3b8a40cf04 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:06:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:06:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:06:36 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:06:36 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:06:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:06:36 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:06:36 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:06:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d4b3a24f-7dc5-4e45-a0df-db3b8a40cf04 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:06:36 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-348d02f0-d40c-4610-be1e-83a084ac5e31 tempest-GroupsTest-615311935 None] Group tempest-Group1-1810363565: created successfully Jun 29 11:06:36 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-348d02f0-d40c-4610-be1e-83a084ac5e31 tempest-GroupsTest-615311935 None] Create group completed successfully. Jun 29 11:06:36 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d4b3a24f-7dc5-4e45-a0df-db3b8a40cf04 1073741824 Jun 29 11:06:36 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:06:37 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-8c36d2c9-1b63-4046-a1eb-cdb68279fa30 tempest-GroupsTest-615311935 None] Group tempest-Group2-270981078: creating Jun 29 11:06:37 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-8c36d2c9-1b63-4046-a1eb-cdb68279fa30 tempest-GroupsTest-615311935 None] Group tempest-Group2-270981078: created successfully Jun 29 11:06:37 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-8c36d2c9-1b63-4046-a1eb-cdb68279fa30 tempest-GroupsTest-615311935 None] Create group completed successfully. Jun 29 11:06:38 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Jun 29 11:06:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d4b3a24f-7dc5-4e45-a0df-db3b8a40cf04 1073741824" returned: 0 in 1.989s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:06:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d4b3a24f-7dc5-4e45-a0df-db3b8a40cf04 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:06:38 devstack sudo[96127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d4b3a24f-7dc5-4e45-a0df-db3b8a40cf04 Jun 29 11:06:38 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:06:39 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:06:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] Flow 'volume_create_manager' (0990ded6-fa1c-42c9-8ffd-271c11979364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:06:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13db89eb-6023-4c32-8409-1cf99b3593c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:06:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13db89eb-6023-4c32-8409-1cf99b3593c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1523325080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b36ac0b-6d25-4be9-9a8e-d1c4d85d6a85,host='devstack@QuobyteHD#QuobyteHD',id=95273d72-d5f6-48f6-8963-112d85a2e36b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f7d21ce40a451b9cee1f7819bed080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:06:39Z,use_quota=True,user_id='9952abafa0ff4e149adc141b736284b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a422969d-73fd-4ebb-93ec-c8e9faa1d6d7),volume_type_id=a422969d-73fd-4ebb-93ec-c8e9faa1d6d7)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:06:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc4a5c6-641f-423f-986e-989f7d1e00ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:06:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc4a5c6-641f-423f-986e-989f7d1e00ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:06:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec35e5b-6a50-4775-8716-4e5e75d96750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:06:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec35e5b-6a50-4775-8716-4e5e75d96750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95273d72-d5f6-48f6-8963-112d85a2e36b', 'volume_name': 'volume-95273d72-d5f6-48f6-8963-112d85a2e36b', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:06:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb0ed32f-5fdb-475d-88f6-a49b820a728d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:06:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb0ed32f-5fdb-475d-88f6-a49b820a728d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:06:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e355270-a0c6-4344-b443-b0af8b96437a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:06:39 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] Volume 95273d72-d5f6-48f6-8963-112d85a2e36b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95273d72-d5f6-48f6-8963-112d85a2e36b', 'volume_size': 1} Jun 29 11:06:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:06:39 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root Jun 29 11:06:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d4b3a24f-7dc5-4e45-a0df-db3b8a40cf04" returned: 0 in 1.430s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:06:39 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] <== create_volume: return (3545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:06:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.549s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:06:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.078s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:06:39 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6b36ac0b-6d25-4be9-9a8e-d1c4d85d6a85,created_at=2026-06-29T09:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1523325080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6b36ac0b-6d25-4be9-9a8e-d1c4d85d6a85,host='devstack@QuobyteHD#QuobyteHD',id=95273d72-d5f6-48f6-8963-112d85a2e36b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f7d21ce40a451b9cee1f7819bed080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:06:39Z,use_quota=True,user_id='9952abafa0ff4e149adc141b736284b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a422969d-73fd-4ebb-93ec-c8e9faa1d6d7),volume_type_id=a422969d-73fd-4ebb-93ec-c8e9faa1d6d7)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:06:39 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] Creating volume 95273d72-d5f6-48f6-8963-112d85a2e36b {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:06:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:06:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:06:39 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:06:39 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:06:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:06:39 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:06:39 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:06:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-95273d72-d5f6-48f6-8963-112d85a2e36b 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:06:39 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-95273d72-d5f6-48f6-8963-112d85a2e36b 1073741824 Jun 29 11:06:39 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:06:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7314236d-1ec8-4819-bd79-a1242a56ece9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4b3a24f-7dc5-4e45-a0df-db3b8a40cf04', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:06:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf434b60-a580-4c1b-bb16-66d67c396618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:06:39 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] Volume volume-d4b3a24f-7dc5-4e45-a0df-db3b8a40cf04 (d4b3a24f-7dc5-4e45-a0df-db3b8a40cf04): created successfully Jun 29 11:06:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf434b60-a580-4c1b-bb16-66d67c396618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:06:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] Flow 'volume_create_manager' (936139a8-b2f2-4647-b98b-5bc4ca79c4fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:06:39 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-8e4326cb-fae5-46d5-9c13-66d052ea0672 tempest-ServerRescueNegativeTestJSON-2131852824 None] Created volume successfully. Jun 29 11:06:41 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Jun 29 11:06:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-95273d72-d5f6-48f6-8963-112d85a2e36b 1073741824" returned: 0 in 1.244s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:06:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-95273d72-d5f6-48f6-8963-112d85a2e36b {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:06:41 devstack sudo[96137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-95273d72-d5f6-48f6-8963-112d85a2e36b Jun 29 11:06:41 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:06:42 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root Jun 29 11:06:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-95273d72-d5f6-48f6-8963-112d85a2e36b" returned: 0 in 1.089s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:06:42 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] <== create_volume: return (2413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:06:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.416s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:06:42 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e355270-a0c6-4344-b443-b0af8b96437a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95273d72-d5f6-48f6-8963-112d85a2e36b', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:06:42 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b63ec160-a779-4d96-9dd8-bcbd15dffeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:06:42 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] Volume volume-95273d72-d5f6-48f6-8963-112d85a2e36b (95273d72-d5f6-48f6-8963-112d85a2e36b): created successfully Jun 29 11:06:42 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b63ec160-a779-4d96-9dd8-bcbd15dffeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:06:42 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] Flow 'volume_create_manager' (0990ded6-fa1c-42c9-8ffd-271c11979364) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:06:42 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-8df6c212-6f00-4ce5-9dee-ef43908cbefb tempest-GroupsTest-615311935 None] Created volume successfully. Jun 29 11:06:43 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-9f9ab960-1463-4167-a52a-e56146dabf5e tempest-GroupsTest-615311935 None] Acquiring lock "cinder-quobyte-95273d72-d5f6-48f6-8963-112d85a2e36b" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:06:43 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-9f9ab960-1463-4167-a52a-e56146dabf5e tempest-GroupsTest-615311935 None] Lock "cinder-quobyte-95273d72-d5f6-48f6-8963-112d85a2e36b" acquired by "delete_volume" :: waited 0.026s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:06:43 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6201f3a5-20cb-4fab-bcdf-03d90ddbefcf]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:06:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9f9ab960-1463-4167-a52a-e56146dabf5e tempest-GroupsTest-615311935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-95273d72-d5f6-48f6-8963-112d85a2e36b {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:06:43 devstack sudo[96180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-95273d72-d5f6-48f6-8963-112d85a2e36b Jun 29 11:06:43 devstack sudo[96180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:06:44 devstack sudo[96180]: pam_unix(sudo:session): session closed for user root Jun 29 11:06:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9f9ab960-1463-4167-a52a-e56146dabf5e tempest-GroupsTest-615311935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-95273d72-d5f6-48f6-8963-112d85a2e36b" returned: 0 in 1.181s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:06:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9f9ab960-1463-4167-a52a-e56146dabf5e tempest-GroupsTest-615311935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-95273d72-d5f6-48f6-8963-112d85a2e36b {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:06:44 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-95273d72-d5f6-48f6-8963-112d85a2e36b Jun 29 11:06:44 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:06:47 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Jun 29 11:06:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9f9ab960-1463-4167-a52a-e56146dabf5e tempest-GroupsTest-615311935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-95273d72-d5f6-48f6-8963-112d85a2e36b" returned: 0 in 2.483s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:06:47 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-9f9ab960-1463-4167-a52a-e56146dabf5e tempest-GroupsTest-615311935 None] Lock "cinder-quobyte-95273d72-d5f6-48f6-8963-112d85a2e36b" released by "delete_volume" :: held 3.729s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:06:47 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-9f9ab960-1463-4167-a52a-e56146dabf5e tempest-GroupsTest-615311935 None] Created reservations ['1451322d-318c-47c3-bb18-432b8a6f5fc3'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:06:47 devstack cinder-volume[93497]: WARNING cinder.quota [None req-9f9ab960-1463-4167-a52a-e56146dabf5e tempest-GroupsTest-615311935 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1957373480 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1957373480, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:06:47 devstack cinder-volume[93497]: WARNING cinder.quota [None req-9f9ab960-1463-4167-a52a-e56146dabf5e tempest-GroupsTest-615311935 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1957373480 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1957373480, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:06:47 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-9f9ab960-1463-4167-a52a-e56146dabf5e tempest-GroupsTest-615311935 None] Created reservations ['e9b836cc-b25d-4bc9-8d90-a1383b810b9e', 'f7550975-efff-476f-bf9f-8fdcc8366e42', '594a9e31-898a-437f-a547-abc455baea81', 'a668e0a0-7973-4d75-96b2-2fe793b58fc1'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:06:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9f9ab960-1463-4167-a52a-e56146dabf5e tempest-GroupsTest-615311935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:06:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9f9ab960-1463-4167-a52a-e56146dabf5e tempest-GroupsTest-615311935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:06:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9f9ab960-1463-4167-a52a-e56146dabf5e tempest-GroupsTest-615311935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:06:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9f9ab960-1463-4167-a52a-e56146dabf5e tempest-GroupsTest-615311935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:06:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9f9ab960-1463-4167-a52a-e56146dabf5e tempest-GroupsTest-615311935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:06:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9f9ab960-1463-4167-a52a-e56146dabf5e tempest-GroupsTest-615311935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:06:47 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:06:47 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:06:48 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-59148f67-3d8f-44f3-8b42-4c5bc160692c tempest-GroupsTest-615311935 None] Created reservations ['a530e7ce-5b9e-4b6f-b47e-0f2059e7baa9'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:06:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-59148f67-3d8f-44f3-8b42-4c5bc160692c tempest-GroupsTest-615311935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:06:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-59148f67-3d8f-44f3-8b42-4c5bc160692c tempest-GroupsTest-615311935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:06:48 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-59148f67-3d8f-44f3-8b42-4c5bc160692c tempest-GroupsTest-615311935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:06:48 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-59148f67-3d8f-44f3-8b42-4c5bc160692c tempest-GroupsTest-615311935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:06:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-59148f67-3d8f-44f3-8b42-4c5bc160692c tempest-GroupsTest-615311935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:06:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-59148f67-3d8f-44f3-8b42-4c5bc160692c tempest-GroupsTest-615311935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:06:48 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:06:48 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:06:48 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Jun 29 11:06:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9f9ab960-1463-4167-a52a-e56146dabf5e tempest-GroupsTest-615311935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.215s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:06:48 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-9f9ab960-1463-4167-a52a-e56146dabf5e tempest-GroupsTest-615311935 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:06:48 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-9f9ab960-1463-4167-a52a-e56146dabf5e tempest-GroupsTest-615311935 None] Delete group completed successfully. Jun 29 11:06:49 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Jun 29 11:06:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-59148f67-3d8f-44f3-8b42-4c5bc160692c tempest-GroupsTest-615311935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.136s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:06:49 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-59148f67-3d8f-44f3-8b42-4c5bc160692c tempest-GroupsTest-615311935 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:06:49 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-59148f67-3d8f-44f3-8b42-4c5bc160692c tempest-GroupsTest-615311935 None] Delete group completed successfully. Jun 29 11:06:50 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-57811778-4e64-4197-8e7c-014c44055905 tempest-GroupsTest-615311935 None] Group tempest-GroupsTest-Group-1873187679: creating Jun 29 11:06:50 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-57811778-4e64-4197-8e7c-014c44055905 tempest-GroupsTest-615311935 None] Group tempest-GroupsTest-Group-1873187679: created successfully Jun 29 11:06:50 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-57811778-4e64-4197-8e7c-014c44055905 tempest-GroupsTest-615311935 None] Create group completed successfully. Jun 29 11:06:53 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:06:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] Flow 'volume_create_manager' (da9b8578-1965-4a4d-ab4a-25a8dfd3d809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:06:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c52489e-1c41-44d1-90be-2c181de47232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:06:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c52489e-1c41-44d1-90be-2c181de47232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1814853694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b03e9786-407e-41e3-a27d-e79bc2303f5d,host='devstack@QuobyteHD#QuobyteHD',id=6a748a6c-0022-41ba-b007-401bb90fc518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f7d21ce40a451b9cee1f7819bed080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:06:53Z,use_quota=True,user_id='9952abafa0ff4e149adc141b736284b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(743bfb96-0be1-47a0-8c60-fc0348b765a3),volume_type_id=743bfb96-0be1-47a0-8c60-fc0348b765a3)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:06:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af46162-afa5-4098-8700-0edf7f6233ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:06:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af46162-afa5-4098-8700-0edf7f6233ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:06:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd87bb4-11b1-4c9b-ab6c-6bcd42e74c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:06:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd87bb4-11b1-4c9b-ab6c-6bcd42e74c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a748a6c-0022-41ba-b007-401bb90fc518', 'volume_name': 'volume-6a748a6c-0022-41ba-b007-401bb90fc518', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:06:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed14b6c1-6eb8-433e-b414-d79a8ef952d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:06:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed14b6c1-6eb8-433e-b414-d79a8ef952d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:06:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bba4187-51a5-4408-8ee4-b9b8eb99742f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:06:53 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] Volume 6a748a6c-0022-41ba-b007-401bb90fc518: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a748a6c-0022-41ba-b007-401bb90fc518', 'volume_size': 1} Jun 29 11:06:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:06:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:06:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b03e9786-407e-41e3-a27d-e79bc2303f5d,created_at=2026-06-29T09:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1814853694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b03e9786-407e-41e3-a27d-e79bc2303f5d,host='devstack@QuobyteHD#QuobyteHD',id=6a748a6c-0022-41ba-b007-401bb90fc518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f7d21ce40a451b9cee1f7819bed080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:06:53Z,use_quota=True,user_id='9952abafa0ff4e149adc141b736284b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(743bfb96-0be1-47a0-8c60-fc0348b765a3),volume_type_id=743bfb96-0be1-47a0-8c60-fc0348b765a3)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:06:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] Creating volume 6a748a6c-0022-41ba-b007-401bb90fc518 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:06:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:06:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:06:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:06:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:06:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:06:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:06:53 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:06:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6a748a6c-0022-41ba-b007-401bb90fc518 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:06:53 devstack sudo[96415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6a748a6c-0022-41ba-b007-401bb90fc518 1073741824 Jun 29 11:06:53 devstack sudo[96415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:06:56 devstack sudo[96415]: pam_unix(sudo:session): session closed for user root Jun 29 11:06:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6a748a6c-0022-41ba-b007-401bb90fc518 1073741824" returned: 0 in 2.787s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:06:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6a748a6c-0022-41ba-b007-401bb90fc518 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:06:56 devstack sudo[96443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6a748a6c-0022-41ba-b007-401bb90fc518 Jun 29 11:06:56 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:06:58 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root Jun 29 11:06:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6a748a6c-0022-41ba-b007-401bb90fc518" returned: 0 in 2.217s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:06:58 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] <== create_volume: return (5173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:06:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 5.202s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:06:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bba4187-51a5-4408-8ee4-b9b8eb99742f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a748a6c-0022-41ba-b007-401bb90fc518', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:06:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3de7ed4-6675-459f-b1bf-f3ed0de4a00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:06:58 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] Volume volume-6a748a6c-0022-41ba-b007-401bb90fc518 (6a748a6c-0022-41ba-b007-401bb90fc518): created successfully Jun 29 11:06:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3de7ed4-6675-459f-b1bf-f3ed0de4a00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:06:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] Flow 'volume_create_manager' (da9b8578-1965-4a4d-ab4a-25a8dfd3d809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:06:58 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-ca41a526-104b-4116-8696-ad7a8991d262 tempest-GroupsTest-615311935 None] Created volume successfully. Jun 29 11:07:01 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:07:01 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] Flow 'volume_create_manager' (29e7cbc5-da8e-41b9-bb8b-231e7aabffac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:07:01 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191ad373-392b-4789-8bbe-677fca7f6efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:07:01 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191ad373-392b-4789-8bbe-677fca7f6efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1543324976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b03e9786-407e-41e3-a27d-e79bc2303f5d,host='devstack@QuobyteHD#QuobyteHD',id=feecbfab-6de7-42a4-af49-168fea23d3bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f7d21ce40a451b9cee1f7819bed080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:07:01Z,use_quota=True,user_id='9952abafa0ff4e149adc141b736284b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(743bfb96-0be1-47a0-8c60-fc0348b765a3),volume_type_id=743bfb96-0be1-47a0-8c60-fc0348b765a3)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:07:01 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc1bbde6-c0b3-40e0-9abb-620e6462379d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:07:01 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc1bbde6-c0b3-40e0-9abb-620e6462379d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:07:01 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f42b7a-8211-4535-9729-cf736bb427aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:07:01 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f42b7a-8211-4535-9729-cf736bb427aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feecbfab-6de7-42a4-af49-168fea23d3bb', 'volume_name': 'volume-feecbfab-6de7-42a4-af49-168fea23d3bb', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:07:01 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e83f3b39-5e64-4ae2-a2fd-bb51099a1016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:07:01 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e83f3b39-5e64-4ae2-a2fd-bb51099a1016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:07:01 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3793f4e7-cd97-444e-8279-03965b08e5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:07:01 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] Volume feecbfab-6de7-42a4-af49-168fea23d3bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feecbfab-6de7-42a4-af49-168fea23d3bb', 'volume_size': 1} Jun 29 11:07:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:07:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:07:01 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b03e9786-407e-41e3-a27d-e79bc2303f5d,created_at=2026-06-29T09:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1543324976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b03e9786-407e-41e3-a27d-e79bc2303f5d,host='devstack@QuobyteHD#QuobyteHD',id=feecbfab-6de7-42a4-af49-168fea23d3bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f7d21ce40a451b9cee1f7819bed080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:07:01Z,use_quota=True,user_id='9952abafa0ff4e149adc141b736284b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(743bfb96-0be1-47a0-8c60-fc0348b765a3),volume_type_id=743bfb96-0be1-47a0-8c60-fc0348b765a3)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:07:01 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] Creating volume feecbfab-6de7-42a4-af49-168fea23d3bb {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:07:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:07:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:07:01 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:07:01 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:07:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:07:01 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:07:01 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:07:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-feecbfab-6de7-42a4-af49-168fea23d3bb 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:07:02 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-feecbfab-6de7-42a4-af49-168fea23d3bb 1073741824 Jun 29 11:07:02 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:07:04 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Jun 29 11:07:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-feecbfab-6de7-42a4-af49-168fea23d3bb 1073741824" returned: 0 in 2.866s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:07:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-feecbfab-6de7-42a4-af49-168fea23d3bb {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:07:04 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-feecbfab-6de7-42a4-af49-168fea23d3bb Jun 29 11:07:04 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:07:06 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Jun 29 11:07:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-feecbfab-6de7-42a4-af49-168fea23d3bb" returned: 0 in 1.338s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:07:06 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] <== create_volume: return (4346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:07:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.352s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:07:06 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3793f4e7-cd97-444e-8279-03965b08e5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feecbfab-6de7-42a4-af49-168fea23d3bb', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:07:06 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b99f9d1-00cf-4460-ad53-bcac3f9124f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:07:06 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] Volume volume-feecbfab-6de7-42a4-af49-168fea23d3bb (feecbfab-6de7-42a4-af49-168fea23d3bb): created successfully Jun 29 11:07:06 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b99f9d1-00cf-4460-ad53-bcac3f9124f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:07:06 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] Flow 'volume_create_manager' (29e7cbc5-da8e-41b9-bb8b-231e7aabffac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:07:06 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-11b79855-c7fe-48d0-ad2b-600e2d9a13ab tempest-GroupsTest-615311935 None] Created volume successfully. Jun 29 11:07:07 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-49876e41-d00d-475b-89ea-28234eefcfe7 tempest-GroupsTest-615311935 None] Update group completed successfully. Jun 29 11:07:07 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:07:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:07:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:07:07 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:07:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:07:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:07:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:07:08 devstack sudo[96630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:07:08 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:07:10 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root Jun 29 11:07:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 2.134s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:07:10 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:07:10 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager._thread_info {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:07:10 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread count: 8 {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 11:07:10 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread info: [<_MainThread(MainThread, started 131117520400512)>, , , , , , , ] {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 11:07:10 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-336e802c-b24d-4144-86c5-39e6c814b566 tempest-GroupsTest-615311935 None] Update group completed successfully. Jun 29 11:07:11 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-45dc84d2-659a-4a1a-9829-1050a878bee3 tempest-ServerRescueNegativeTestJSON-2131852824 None] Acquiring lock "cinder-d4b3a24f-7dc5-4e45-a0df-db3b8a40cf04-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:07:11 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-45dc84d2-659a-4a1a-9829-1050a878bee3 tempest-ServerRescueNegativeTestJSON-2131852824 None] Lock "cinder-d4b3a24f-7dc5-4e45-a0df-db3b8a40cf04-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:07:12 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-45dc84d2-659a-4a1a-9829-1050a878bee3 tempest-ServerRescueNegativeTestJSON-2131852824 None] Acquiring lock "cinder-quobyte-d4b3a24f-7dc5-4e45-a0df-db3b8a40cf04" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:07:12 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-45dc84d2-659a-4a1a-9829-1050a878bee3 tempest-ServerRescueNegativeTestJSON-2131852824 None] Lock "cinder-quobyte-d4b3a24f-7dc5-4e45-a0df-db3b8a40cf04" acquired by "delete_volume" :: waited 0.029s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:07:12 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5be2287-da43-4d71-8915-dea756049d42]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:07:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-45dc84d2-659a-4a1a-9829-1050a878bee3 tempest-ServerRescueNegativeTestJSON-2131852824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d4b3a24f-7dc5-4e45-a0df-db3b8a40cf04 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:07:12 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d4b3a24f-7dc5-4e45-a0df-db3b8a40cf04 Jun 29 11:07:12 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:07:13 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ebe0c73b-2df7-4dd3-9931-815d939f6c35 tempest-GroupsTest-615311935 None] Acquiring lock "cinder-quobyte-6a748a6c-0022-41ba-b007-401bb90fc518" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:07:13 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ebe0c73b-2df7-4dd3-9931-815d939f6c35 tempest-GroupsTest-615311935 None] Lock "cinder-quobyte-6a748a6c-0022-41ba-b007-401bb90fc518" acquired by "delete_volume" :: waited 0.059s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:07:13 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c6fab2-1268-4757-b303-5979816dc3cb]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:07:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ebe0c73b-2df7-4dd3-9931-815d939f6c35 tempest-GroupsTest-615311935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6a748a6c-0022-41ba-b007-401bb90fc518 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:07:13 devstack sudo[96731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6a748a6c-0022-41ba-b007-401bb90fc518 Jun 29 11:07:13 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:07:14 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Jun 29 11:07:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-45dc84d2-659a-4a1a-9829-1050a878bee3 tempest-ServerRescueNegativeTestJSON-2131852824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d4b3a24f-7dc5-4e45-a0df-db3b8a40cf04" returned: 0 in 2.162s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:07:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-45dc84d2-659a-4a1a-9829-1050a878bee3 tempest-ServerRescueNegativeTestJSON-2131852824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d4b3a24f-7dc5-4e45-a0df-db3b8a40cf04 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:07:14 devstack sudo[96737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d4b3a24f-7dc5-4e45-a0df-db3b8a40cf04 Jun 29 11:07:14 devstack sudo[96737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:07:15 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root Jun 29 11:07:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ebe0c73b-2df7-4dd3-9931-815d939f6c35 tempest-GroupsTest-615311935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6a748a6c-0022-41ba-b007-401bb90fc518" returned: 0 in 2.160s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:07:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ebe0c73b-2df7-4dd3-9931-815d939f6c35 tempest-GroupsTest-615311935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6a748a6c-0022-41ba-b007-401bb90fc518 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:07:15 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6a748a6c-0022-41ba-b007-401bb90fc518 Jun 29 11:07:15 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:07:15 devstack sudo[96737]: pam_unix(sudo:session): session closed for user root Jun 29 11:07:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-45dc84d2-659a-4a1a-9829-1050a878bee3 tempest-ServerRescueNegativeTestJSON-2131852824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d4b3a24f-7dc5-4e45-a0df-db3b8a40cf04" returned: 0 in 1.445s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:07:15 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-45dc84d2-659a-4a1a-9829-1050a878bee3 tempest-ServerRescueNegativeTestJSON-2131852824 None] Lock "cinder-quobyte-d4b3a24f-7dc5-4e45-a0df-db3b8a40cf04" released by "delete_volume" :: held 3.684s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:07:15 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-45dc84d2-659a-4a1a-9829-1050a878bee3 tempest-ServerRescueNegativeTestJSON-2131852824 None] Created reservations ['ec7cb7b0-46ca-4cfb-ad08-994be6a1a1c7', '56943597-3df6-4a60-a6ee-5732473462bb', 'b8b5d8a5-390c-4386-af1d-cb1732c8c63b', 'de362e33-a189-4bc8-a50e-de28bd1fa0df'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:07:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-45dc84d2-659a-4a1a-9829-1050a878bee3 tempest-ServerRescueNegativeTestJSON-2131852824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:07:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-45dc84d2-659a-4a1a-9829-1050a878bee3 tempest-ServerRescueNegativeTestJSON-2131852824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:07:15 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-45dc84d2-659a-4a1a-9829-1050a878bee3 tempest-ServerRescueNegativeTestJSON-2131852824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:07:15 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-45dc84d2-659a-4a1a-9829-1050a878bee3 tempest-ServerRescueNegativeTestJSON-2131852824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:07:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-45dc84d2-659a-4a1a-9829-1050a878bee3 tempest-ServerRescueNegativeTestJSON-2131852824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:07:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-45dc84d2-659a-4a1a-9829-1050a878bee3 tempest-ServerRescueNegativeTestJSON-2131852824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:07:15 devstack sudo[96749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:07:16 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:07:17 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Jun 29 11:07:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ebe0c73b-2df7-4dd3-9931-815d939f6c35 tempest-GroupsTest-615311935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6a748a6c-0022-41ba-b007-401bb90fc518" returned: 0 in 1.664s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:07:17 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ebe0c73b-2df7-4dd3-9931-815d939f6c35 tempest-GroupsTest-615311935 None] Lock "cinder-quobyte-6a748a6c-0022-41ba-b007-401bb90fc518" released by "delete_volume" :: held 3.984s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:07:17 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ebe0c73b-2df7-4dd3-9931-815d939f6c35 tempest-GroupsTest-615311935 None] Acquiring lock "cinder-quobyte-feecbfab-6de7-42a4-af49-168fea23d3bb" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:07:17 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ebe0c73b-2df7-4dd3-9931-815d939f6c35 tempest-GroupsTest-615311935 None] Lock "cinder-quobyte-feecbfab-6de7-42a4-af49-168fea23d3bb" acquired by "delete_volume" :: waited 0.047s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:07:17 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root Jun 29 11:07:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-45dc84d2-659a-4a1a-9829-1050a878bee3 tempest-ServerRescueNegativeTestJSON-2131852824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.452s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:07:17 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-45dc84d2-659a-4a1a-9829-1050a878bee3 tempest-ServerRescueNegativeTestJSON-2131852824 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:07:17 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-45dc84d2-659a-4a1a-9829-1050a878bee3 tempest-ServerRescueNegativeTestJSON-2131852824 None] Deleted volume successfully. Jun 29 11:07:17 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a902e0ce-467f-439e-9ced-f5cc16e16583]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:07:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ebe0c73b-2df7-4dd3-9931-815d939f6c35 tempest-GroupsTest-615311935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-feecbfab-6de7-42a4-af49-168fea23d3bb {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:07:17 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-45dc84d2-659a-4a1a-9829-1050a878bee3 tempest-ServerRescueNegativeTestJSON-2131852824 None] Lock "cinder-d4b3a24f-7dc5-4e45-a0df-db3b8a40cf04-delete_volume" released by "delete_volume" :: held 5.609s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:07:17 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-feecbfab-6de7-42a4-af49-168fea23d3bb Jun 29 11:07:17 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:07:19 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Jun 29 11:07:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ebe0c73b-2df7-4dd3-9931-815d939f6c35 tempest-GroupsTest-615311935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-feecbfab-6de7-42a4-af49-168fea23d3bb" returned: 0 in 2.312s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:07:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ebe0c73b-2df7-4dd3-9931-815d939f6c35 tempest-GroupsTest-615311935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-feecbfab-6de7-42a4-af49-168fea23d3bb {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:07:19 devstack sudo[96804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-feecbfab-6de7-42a4-af49-168fea23d3bb Jun 29 11:07:19 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:07:21 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root Jun 29 11:07:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ebe0c73b-2df7-4dd3-9931-815d939f6c35 tempest-GroupsTest-615311935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-feecbfab-6de7-42a4-af49-168fea23d3bb" returned: 0 in 1.321s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:07:21 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ebe0c73b-2df7-4dd3-9931-815d939f6c35 tempest-GroupsTest-615311935 None] Lock "cinder-quobyte-feecbfab-6de7-42a4-af49-168fea23d3bb" released by "delete_volume" :: held 3.763s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:07:21 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-ebe0c73b-2df7-4dd3-9931-815d939f6c35 tempest-GroupsTest-615311935 None] Created reservations ['ce60558d-3350-4f8c-b11f-2a5605da1c61'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:07:21 devstack cinder-volume[93497]: WARNING cinder.quota [None req-ebe0c73b-2df7-4dd3-9931-815d939f6c35 tempest-GroupsTest-615311935 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-566031110 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-566031110, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:07:21 devstack cinder-volume[93497]: WARNING cinder.quota [None req-ebe0c73b-2df7-4dd3-9931-815d939f6c35 tempest-GroupsTest-615311935 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-566031110 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-566031110, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:07:21 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-ebe0c73b-2df7-4dd3-9931-815d939f6c35 tempest-GroupsTest-615311935 None] Created reservations ['b2414070-6e69-4f4f-9379-8daed8537975', '340a0ba1-e9cb-4c80-a5cf-24dfc10b3143', 'a1e6c4fd-2b21-4448-8b29-4df748a9efb2', '399bd8a0-c821-44fc-b3b7-96caf4a8c766'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:07:21 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-ebe0c73b-2df7-4dd3-9931-815d939f6c35 tempest-GroupsTest-615311935 None] Created reservations ['d84077f9-ba9d-4f8f-989e-ce24c402c78e', 'a5ad7bac-8675-4333-836e-4efea404969b', 'ebf33a5c-b1b1-4134-ae0b-2942ba18ef06', 'c0ab1b63-0c59-467f-a271-daa6589f0d9e'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:07:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ebe0c73b-2df7-4dd3-9931-815d939f6c35 tempest-GroupsTest-615311935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:07:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ebe0c73b-2df7-4dd3-9931-815d939f6c35 tempest-GroupsTest-615311935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:07:22 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ebe0c73b-2df7-4dd3-9931-815d939f6c35 tempest-GroupsTest-615311935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:07:22 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ebe0c73b-2df7-4dd3-9931-815d939f6c35 tempest-GroupsTest-615311935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:07:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ebe0c73b-2df7-4dd3-9931-815d939f6c35 tempest-GroupsTest-615311935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:07:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ebe0c73b-2df7-4dd3-9931-815d939f6c35 tempest-GroupsTest-615311935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:07:22 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:07:22 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:07:24 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Jun 29 11:07:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ebe0c73b-2df7-4dd3-9931-815d939f6c35 tempest-GroupsTest-615311935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.941s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:07:24 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-ebe0c73b-2df7-4dd3-9931-815d939f6c35 tempest-GroupsTest-615311935 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:07:24 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-ebe0c73b-2df7-4dd3-9931-815d939f6c35 tempest-GroupsTest-615311935 None] Delete group completed successfully. Jun 29 11:07:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-c282b839-d2be-487e-926c-c553d76d288e req-597615de-cebb-43ce-99b8-9fe79621ef9b tempest-ServerActionsTestOtherA-772013197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:07:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-c282b839-d2be-487e-926c-c553d76d288e req-597615de-cebb-43ce-99b8-9fe79621ef9b tempest-ServerActionsTestOtherA-772013197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:07:27 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e3cc0f-5f31-4cad-8f0f-339da8e94161]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:07:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-c282b839-d2be-487e-926c-c553d76d288e req-597615de-cebb-43ce-99b8-9fe79621ef9b tempest-ServerActionsTestOtherA-772013197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c8dc1235-d3ab-4dfe-9b53-65bac30367b3 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:07:27 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c8dc1235-d3ab-4dfe-9b53-65bac30367b3 Jun 29 11:07:27 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:07:28 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Jun 29 11:07:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-c282b839-d2be-487e-926c-c553d76d288e req-597615de-cebb-43ce-99b8-9fe79621ef9b tempest-ServerActionsTestOtherA-772013197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c8dc1235-d3ab-4dfe-9b53-65bac30367b3" returned: 0 in 1.215s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:07:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-c282b839-d2be-487e-926c-c553d76d288e req-597615de-cebb-43ce-99b8-9fe79621ef9b tempest-ServerActionsTestOtherA-772013197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.251s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:07:28 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-c282b839-d2be-487e-926c-c553d76d288e req-597615de-cebb-43ce-99b8-9fe79621ef9b tempest-ServerActionsTestOtherA-772013197 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3', 'name': 'volume-c8dc1235-d3ab-4dfe-9b53-65bac30367b3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '780c18d0-bc95-4116-a10f-924e2a108629', 'enforce_multipath': True} {{(pid=93497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 11:07:28 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-c282b839-d2be-487e-926c-c553d76d288e req-597615de-cebb-43ce-99b8-9fe79621ef9b tempest-ServerActionsTestOtherA-772013197 None] attachment_update completed successfully. Jun 29 11:07:38 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=54,cinder:UPDATE=62,cinder:INSERT=13,cinder:DELETE=3 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:07:38 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:UPDATE=55,cinder:SELECT=54,cinder:INSERT=10,cinder:DELETE=2 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:07:38 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-03340601-7f09-4c5e-9309-fe6b9eaf37ef req-38875040-e996-4b18-bc8d-51b1feb3152a tempest-ServerActionsTestOtherA-772013197 None] Terminate volume connection completed successfully. Jun 29 11:07:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-03340601-7f09-4c5e-9309-fe6b9eaf37ef req-38875040-e996-4b18-bc8d-51b1feb3152a tempest-ServerActionsTestOtherA-772013197 None] Deleting attachment 780c18d0-bc95-4116-a10f-924e2a108629. {{(pid=93497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 11:07:38 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:07:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] Flow 'volume_create_manager' (ca45f20e-cd80-426a-8f12-cf5241954e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:07:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5228640-8933-466e-a93f-1373a2a745ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:07:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5228640-8933-466e-a93f-1373a2a745ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-581378440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7975ce89-b195-4644-b424-6a004f14536c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a3059c952148dfbec6d18773557d18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:07:39Z,use_quota=True,user_id='815bb942d44d417c89f2f14092f61665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:07:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3073e750-eb6b-45c9-abea-a5e9ff235fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:07:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3073e750-eb6b-45c9-abea-a5e9ff235fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:07:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ad09d7-e539-4dce-bf7f-7284908aea71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:07:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ad09d7-e539-4dce-bf7f-7284908aea71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7975ce89-b195-4644-b424-6a004f14536c', 'volume_name': 'volume-7975ce89-b195-4644-b424-6a004f14536c', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:07:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07100e4d-d392-4942-b978-75fce8610514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:07:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07100e4d-d392-4942-b978-75fce8610514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:07:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c5d3672-2ea2-4237-8ad4-c2603ecbaa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:07:38 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] Volume 7975ce89-b195-4644-b424-6a004f14536c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7975ce89-b195-4644-b424-6a004f14536c', 'volume_size': 1} Jun 29 11:07:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:07:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:07:38 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-581378440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7975ce89-b195-4644-b424-6a004f14536c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a3059c952148dfbec6d18773557d18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:07:39Z,use_quota=True,user_id='815bb942d44d417c89f2f14092f61665',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:07:38 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] Creating volume 7975ce89-b195-4644-b424-6a004f14536c {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:07:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:07:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:07:38 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:07:38 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:07:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:07:38 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:07:38 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:07:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7975ce89-b195-4644-b424-6a004f14536c 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:07:38 devstack sudo[97352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7975ce89-b195-4644-b424-6a004f14536c 1073741824 Jun 29 11:07:38 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:07:40 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root Jun 29 11:07:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7975ce89-b195-4644-b424-6a004f14536c 1073741824" returned: 0 in 1.272s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:07:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7975ce89-b195-4644-b424-6a004f14536c {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:07:40 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7975ce89-b195-4644-b424-6a004f14536c Jun 29 11:07:40 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:07:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-03340601-7f09-4c5e-9309-fe6b9eaf37ef req-2ef37065-c2a6-4c4d-a290-227bc13aebda tempest-ServerActionsTestOtherA-772013197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:07:41 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Jun 29 11:07:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7975ce89-b195-4644-b424-6a004f14536c" returned: 0 in 0.926s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:07:41 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] <== create_volume: return (2275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:07:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.286s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:07:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-03340601-7f09-4c5e-9309-fe6b9eaf37ef req-2ef37065-c2a6-4c4d-a290-227bc13aebda tempest-ServerActionsTestOtherA-772013197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.027s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:07:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c5d3672-2ea2-4237-8ad4-c2603ecbaa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7975ce89-b195-4644-b424-6a004f14536c', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:07:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (329c9c3d-87e1-4dd3-9c72-b73c7978ea80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:07:41 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db7b1f4-13bd-47ed-8fd1-302cdca4993b]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:07:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-03340601-7f09-4c5e-9309-fe6b9eaf37ef req-2ef37065-c2a6-4c4d-a290-227bc13aebda tempest-ServerActionsTestOtherA-772013197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c8dc1235-d3ab-4dfe-9b53-65bac30367b3 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:07:41 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] Volume volume-7975ce89-b195-4644-b424-6a004f14536c (7975ce89-b195-4644-b424-6a004f14536c): created successfully Jun 29 11:07:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (329c9c3d-87e1-4dd3-9c72-b73c7978ea80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:07:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] Flow 'volume_create_manager' (ca45f20e-cd80-426a-8f12-cf5241954e92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:07:41 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-9c21f65a-e0dd-4d60-a9fe-dc7a93dcf7d4 tempest-VolumeQuotasNegativeTestJSON-762099352 None] Created volume successfully. Jun 29 11:07:41 devstack sudo[97383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c8dc1235-d3ab-4dfe-9b53-65bac30367b3 Jun 29 11:07:41 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:07:42 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root Jun 29 11:07:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-03340601-7f09-4c5e-9309-fe6b9eaf37ef req-2ef37065-c2a6-4c4d-a290-227bc13aebda tempest-ServerActionsTestOtherA-772013197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c8dc1235-d3ab-4dfe-9b53-65bac30367b3" returned: 0 in 1.815s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:07:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-03340601-7f09-4c5e-9309-fe6b9eaf37ef req-2ef37065-c2a6-4c4d-a290-227bc13aebda tempest-ServerActionsTestOtherA-772013197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.902s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:07:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-03340601-7f09-4c5e-9309-fe6b9eaf37ef req-2ef37065-c2a6-4c4d-a290-227bc13aebda tempest-ServerActionsTestOtherA-772013197 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3', 'name': 'volume-c8dc1235-d3ab-4dfe-9b53-65bac30367b3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0ca29396-8926-4f56-89d9-a0019c2696dc', 'enforce_multipath': True} {{(pid=93497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 11:07:43 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-03340601-7f09-4c5e-9309-fe6b9eaf37ef req-2ef37065-c2a6-4c4d-a290-227bc13aebda tempest-ServerActionsTestOtherA-772013197 None] attachment_update completed successfully. Jun 29 11:07:43 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fd2a3bb2-103d-4c2f-8395-2ff16e3f3c1f tempest-VolumeQuotasNegativeTestJSON-762099352 None] Acquiring lock "cinder-7975ce89-b195-4644-b424-6a004f14536c-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:07:43 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fd2a3bb2-103d-4c2f-8395-2ff16e3f3c1f tempest-VolumeQuotasNegativeTestJSON-762099352 None] Lock "cinder-7975ce89-b195-4644-b424-6a004f14536c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:07:43 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fd2a3bb2-103d-4c2f-8395-2ff16e3f3c1f tempest-VolumeQuotasNegativeTestJSON-762099352 None] Acquiring lock "cinder-quobyte-7975ce89-b195-4644-b424-6a004f14536c" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:07:43 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fd2a3bb2-103d-4c2f-8395-2ff16e3f3c1f tempest-VolumeQuotasNegativeTestJSON-762099352 None] Lock "cinder-quobyte-7975ce89-b195-4644-b424-6a004f14536c" acquired by "delete_volume" :: waited 0.020s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:07:43 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b264d0-12b5-427f-b71b-85b42b5e7303]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:07:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fd2a3bb2-103d-4c2f-8395-2ff16e3f3c1f tempest-VolumeQuotasNegativeTestJSON-762099352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7975ce89-b195-4644-b424-6a004f14536c {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:07:43 devstack sudo[97461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7975ce89-b195-4644-b424-6a004f14536c Jun 29 11:07:43 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:07:44 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root Jun 29 11:07:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fd2a3bb2-103d-4c2f-8395-2ff16e3f3c1f tempest-VolumeQuotasNegativeTestJSON-762099352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7975ce89-b195-4644-b424-6a004f14536c" returned: 0 in 1.048s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:07:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fd2a3bb2-103d-4c2f-8395-2ff16e3f3c1f tempest-VolumeQuotasNegativeTestJSON-762099352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7975ce89-b195-4644-b424-6a004f14536c {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:07:44 devstack sudo[97466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7975ce89-b195-4644-b424-6a004f14536c Jun 29 11:07:44 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:07:45 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root Jun 29 11:07:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fd2a3bb2-103d-4c2f-8395-2ff16e3f3c1f tempest-VolumeQuotasNegativeTestJSON-762099352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7975ce89-b195-4644-b424-6a004f14536c" returned: 0 in 1.049s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:07:45 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fd2a3bb2-103d-4c2f-8395-2ff16e3f3c1f tempest-VolumeQuotasNegativeTestJSON-762099352 None] Lock "cinder-quobyte-7975ce89-b195-4644-b424-6a004f14536c" released by "delete_volume" :: held 2.178s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:07:46 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-fd2a3bb2-103d-4c2f-8395-2ff16e3f3c1f tempest-VolumeQuotasNegativeTestJSON-762099352 None] Created reservations ['335a1b80-ac30-4b58-83e5-0baa1f2c6751', '37b2d4bc-f146-44e2-8722-92f7a437fed3', '123a578f-24e7-4994-a4c8-ed1654d2c94a', 'ae9e8a70-63e1-4b3c-9bff-4278a7424dc5'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:07:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fd2a3bb2-103d-4c2f-8395-2ff16e3f3c1f tempest-VolumeQuotasNegativeTestJSON-762099352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:07:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fd2a3bb2-103d-4c2f-8395-2ff16e3f3c1f tempest-VolumeQuotasNegativeTestJSON-762099352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:07:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-fd2a3bb2-103d-4c2f-8395-2ff16e3f3c1f tempest-VolumeQuotasNegativeTestJSON-762099352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:07:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-fd2a3bb2-103d-4c2f-8395-2ff16e3f3c1f tempest-VolumeQuotasNegativeTestJSON-762099352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:07:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fd2a3bb2-103d-4c2f-8395-2ff16e3f3c1f tempest-VolumeQuotasNegativeTestJSON-762099352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:07:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fd2a3bb2-103d-4c2f-8395-2ff16e3f3c1f tempest-VolumeQuotasNegativeTestJSON-762099352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:07:46 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:07:46 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:07:47 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Jun 29 11:07:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fd2a3bb2-103d-4c2f-8395-2ff16e3f3c1f tempest-VolumeQuotasNegativeTestJSON-762099352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.865s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:07:47 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-fd2a3bb2-103d-4c2f-8395-2ff16e3f3c1f tempest-VolumeQuotasNegativeTestJSON-762099352 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:07:47 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-fd2a3bb2-103d-4c2f-8395-2ff16e3f3c1f tempest-VolumeQuotasNegativeTestJSON-762099352 None] Deleted volume successfully. Jun 29 11:07:47 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fd2a3bb2-103d-4c2f-8395-2ff16e3f3c1f tempest-VolumeQuotasNegativeTestJSON-762099352 None] Lock "cinder-7975ce89-b195-4644-b424-6a004f14536c-delete_volume" released by "delete_volume" :: held 3.397s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:07:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-c865e7a7-7902-43d0-8a4e-6924b0cdf425 req-8dea5494-b18e-4fae-a7c2-07d307efd733 tempest-TaggedAttachmentsTest-735790113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:07:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-c865e7a7-7902-43d0-8a4e-6924b0cdf425 req-8dea5494-b18e-4fae-a7c2-07d307efd733 tempest-TaggedAttachmentsTest-735790113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:07:48 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc1f81c-3cc9-4a3b-a180-911ad5fcacce]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:07:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-c865e7a7-7902-43d0-8a4e-6924b0cdf425 req-8dea5494-b18e-4fae-a7c2-07d307efd733 tempest-TaggedAttachmentsTest-735790113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-31ec9585-ac91-4b01-ae36-0a6b7d0aac72 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:07:48 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-31ec9585-ac91-4b01-ae36-0a6b7d0aac72 Jun 29 11:07:48 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:07:49 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Jun 29 11:07:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-c865e7a7-7902-43d0-8a4e-6924b0cdf425 req-8dea5494-b18e-4fae-a7c2-07d307efd733 tempest-TaggedAttachmentsTest-735790113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-31ec9585-ac91-4b01-ae36-0a6b7d0aac72" returned: 0 in 1.222s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:07:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-c865e7a7-7902-43d0-8a4e-6924b0cdf425 req-8dea5494-b18e-4fae-a7c2-07d307efd733 tempest-TaggedAttachmentsTest-735790113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.268s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:07:49 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-c865e7a7-7902-43d0-8a4e-6924b0cdf425 req-8dea5494-b18e-4fae-a7c2-07d307efd733 tempest-TaggedAttachmentsTest-735790113 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3', 'name': 'volume-31ec9585-ac91-4b01-ae36-0a6b7d0aac72', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8e31681a-3fe5-441f-9cb2-7fe14a6391a3', 'enforce_multipath': True} {{(pid=93497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 11:07:50 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-c865e7a7-7902-43d0-8a4e-6924b0cdf425 req-8dea5494-b18e-4fae-a7c2-07d307efd733 tempest-TaggedAttachmentsTest-735790113 None] attachment_update completed successfully. Jun 29 11:07:58 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:07:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] Flow 'volume_create_manager' (ae031f1e-df11-4ff1-b45e-1684fc96a528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:07:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c71de83a-6e14-457e-9526-922bb08055aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:07:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c71de83a-6e14-457e-9526-922bb08055aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2070573993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fc46830-be59-45ae-adc3-5aff004cf274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a574749992ba499bbf4125dc2573a2c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:07:59Z,use_quota=True,user_id='9cbd9630b3af4dda8557ff5b4d783e0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:07:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b881f61-8011-4022-a485-6fed5f668648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:07:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b881f61-8011-4022-a485-6fed5f668648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:07:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889a4da6-6165-4790-9842-1d75e38ac8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:07:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889a4da6-6165-4790-9842-1d75e38ac8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fc46830-be59-45ae-adc3-5aff004cf274', 'volume_name': 'volume-0fc46830-be59-45ae-adc3-5aff004cf274', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:07:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eca777c-a515-4311-8e19-1860fa650a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:07:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eca777c-a515-4311-8e19-1860fa650a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:07:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (699f7fa8-ab5a-4fee-92f7-57da74fce4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:07:59 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] Volume 0fc46830-be59-45ae-adc3-5aff004cf274: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fc46830-be59-45ae-adc3-5aff004cf274', 'volume_size': 1} Jun 29 11:07:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:07:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:07:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2070573993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fc46830-be59-45ae-adc3-5aff004cf274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a574749992ba499bbf4125dc2573a2c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:07:59Z,use_quota=True,user_id='9cbd9630b3af4dda8557ff5b4d783e0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:07:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] Creating volume 0fc46830-be59-45ae-adc3-5aff004cf274 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:07:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:07:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:07:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:07:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:07:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:07:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:07:59 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:07:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0fc46830-be59-45ae-adc3-5aff004cf274 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:07:59 devstack sudo[97960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0fc46830-be59-45ae-adc3-5aff004cf274 1073741824 Jun 29 11:07:59 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:07:59 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-a4a79eb7-e4db-4388-a469-83025745679e req-4c00620b-bd13-4d1c-a439-5e0a95a01a41 tempest-TaggedAttachmentsTest-735790113 None] Terminate volume connection completed successfully. Jun 29 11:07:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-a4a79eb7-e4db-4388-a469-83025745679e req-4c00620b-bd13-4d1c-a439-5e0a95a01a41 tempest-TaggedAttachmentsTest-735790113 None] Deleting attachment 8e31681a-3fe5-441f-9cb2-7fe14a6391a3. {{(pid=93497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 11:08:00 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root Jun 29 11:08:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0fc46830-be59-45ae-adc3-5aff004cf274 1073741824" returned: 0 in 1.836s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:08:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0fc46830-be59-45ae-adc3-5aff004cf274 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:08:01 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0fc46830-be59-45ae-adc3-5aff004cf274 Jun 29 11:08:01 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:08:02 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Jun 29 11:08:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0fc46830-be59-45ae-adc3-5aff004cf274" returned: 0 in 1.300s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:08:02 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] <== create_volume: return (3225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:08:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.231s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:08:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (699f7fa8-ab5a-4fee-92f7-57da74fce4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fc46830-be59-45ae-adc3-5aff004cf274', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:08:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a40e879-27dd-4980-9fe1-e64c8373289e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:08:02 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] Volume volume-0fc46830-be59-45ae-adc3-5aff004cf274 (0fc46830-be59-45ae-adc3-5aff004cf274): created successfully Jun 29 11:08:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a40e879-27dd-4980-9fe1-e64c8373289e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:08:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] Flow 'volume_create_manager' (ae031f1e-df11-4ff1-b45e-1684fc96a528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:08:02 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-0b3b1a12-6c3e-480d-b37b-35ce48d522b8 tempest-VolumesServicesTestJSON-1343776993 None] Created volume successfully. Jun 29 11:08:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8cf5713b-e607-4cdf-9483-6bf883034f4d tempest-VolumesServicesTestJSON-1343776993 None] Acquiring lock "cinder-0fc46830-be59-45ae-adc3-5aff004cf274-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:08:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8cf5713b-e607-4cdf-9483-6bf883034f4d tempest-VolumesServicesTestJSON-1343776993 None] Lock "cinder-0fc46830-be59-45ae-adc3-5aff004cf274-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:08:04 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8cf5713b-e607-4cdf-9483-6bf883034f4d tempest-VolumesServicesTestJSON-1343776993 None] Acquiring lock "cinder-quobyte-0fc46830-be59-45ae-adc3-5aff004cf274" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:08:04 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8cf5713b-e607-4cdf-9483-6bf883034f4d tempest-VolumesServicesTestJSON-1343776993 None] Lock "cinder-quobyte-0fc46830-be59-45ae-adc3-5aff004cf274" acquired by "delete_volume" :: waited 0.020s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:08:04 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d55f98-26bb-41c0-8a74-d858f493583a]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:08:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8cf5713b-e607-4cdf-9483-6bf883034f4d tempest-VolumesServicesTestJSON-1343776993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0fc46830-be59-45ae-adc3-5aff004cf274 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:08:04 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0fc46830-be59-45ae-adc3-5aff004cf274 Jun 29 11:08:04 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:08:05 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Jun 29 11:08:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8cf5713b-e607-4cdf-9483-6bf883034f4d tempest-VolumesServicesTestJSON-1343776993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0fc46830-be59-45ae-adc3-5aff004cf274" returned: 0 in 1.272s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:08:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8cf5713b-e607-4cdf-9483-6bf883034f4d tempest-VolumesServicesTestJSON-1343776993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0fc46830-be59-45ae-adc3-5aff004cf274 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:08:05 devstack sudo[98019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0fc46830-be59-45ae-adc3-5aff004cf274 Jun 29 11:08:05 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:08:06 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root Jun 29 11:08:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8cf5713b-e607-4cdf-9483-6bf883034f4d tempest-VolumesServicesTestJSON-1343776993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0fc46830-be59-45ae-adc3-5aff004cf274" returned: 0 in 1.153s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:08:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8cf5713b-e607-4cdf-9483-6bf883034f4d tempest-VolumesServicesTestJSON-1343776993 None] Lock "cinder-quobyte-0fc46830-be59-45ae-adc3-5aff004cf274" released by "delete_volume" :: held 2.508s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:08:06 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-8cf5713b-e607-4cdf-9483-6bf883034f4d tempest-VolumesServicesTestJSON-1343776993 None] Created reservations ['4602d11b-31d3-4add-a2c2-0955ae04dec9', '64d78d7a-e621-429e-969a-f838e199a984', '7680f710-30a9-459e-a369-c5fceb1c0948', '6446b7e4-b7d6-4af3-afc0-7a7512c66db9'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:08:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8cf5713b-e607-4cdf-9483-6bf883034f4d tempest-VolumesServicesTestJSON-1343776993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:08:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8cf5713b-e607-4cdf-9483-6bf883034f4d tempest-VolumesServicesTestJSON-1343776993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:08:06 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8cf5713b-e607-4cdf-9483-6bf883034f4d tempest-VolumesServicesTestJSON-1343776993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:08:06 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8cf5713b-e607-4cdf-9483-6bf883034f4d tempest-VolumesServicesTestJSON-1343776993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:08:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8cf5713b-e607-4cdf-9483-6bf883034f4d tempest-VolumesServicesTestJSON-1343776993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:08:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8cf5713b-e607-4cdf-9483-6bf883034f4d tempest-VolumesServicesTestJSON-1343776993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:08:06 devstack sudo[98083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:08:06 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:08:07 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root Jun 29 11:08:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8cf5713b-e607-4cdf-9483-6bf883034f4d tempest-VolumesServicesTestJSON-1343776993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.095s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:08:07 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-8cf5713b-e607-4cdf-9483-6bf883034f4d tempest-VolumesServicesTestJSON-1343776993 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:08:07 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:08:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:08:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:08:07 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:08:07 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:08:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:08:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:08:08 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-8cf5713b-e607-4cdf-9483-6bf883034f4d tempest-VolumesServicesTestJSON-1343776993 None] Deleted volume successfully. Jun 29 11:08:08 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:08:08 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:08:08 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8cf5713b-e607-4cdf-9483-6bf883034f4d tempest-VolumesServicesTestJSON-1343776993 None] Lock "cinder-0fc46830-be59-45ae-adc3-5aff004cf274-delete_volume" released by "delete_volume" :: held 4.072s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:08:08 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Jun 29 11:08:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.804s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:08:08 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:08:16 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=24,cinder:UPDATE=26,cinder:INSERT=5 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:08:18 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:UPDATE=24,cinder:SELECT=28,cinder:DELETE=4,cinder:INSERT=5 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:08:20 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-dd86e5f3-dbd5-4ca4-b881-ad46e76bdba3 req-17deef47-150f-4036-b716-f5864e7ea757 tempest-ServerActionsTestOtherA-772013197 None] Terminate volume connection completed successfully. Jun 29 11:08:20 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-dd86e5f3-dbd5-4ca4-b881-ad46e76bdba3 req-17deef47-150f-4036-b716-f5864e7ea757 tempest-ServerActionsTestOtherA-772013197 None] Deleting attachment 0ca29396-8926-4f56-89d9-a0019c2696dc. {{(pid=93497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 11:08:21 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e54c6538-9cb6-45ec-ab50-30d381ddc5e4 tempest-TaggedAttachmentsTest-735790113 None] Acquiring lock "cinder-31ec9585-ac91-4b01-ae36-0a6b7d0aac72-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:08:21 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e54c6538-9cb6-45ec-ab50-30d381ddc5e4 tempest-TaggedAttachmentsTest-735790113 None] Lock "cinder-31ec9585-ac91-4b01-ae36-0a6b7d0aac72-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:08:22 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e54c6538-9cb6-45ec-ab50-30d381ddc5e4 tempest-TaggedAttachmentsTest-735790113 None] Acquiring lock "cinder-quobyte-31ec9585-ac91-4b01-ae36-0a6b7d0aac72" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:08:22 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e54c6538-9cb6-45ec-ab50-30d381ddc5e4 tempest-TaggedAttachmentsTest-735790113 None] Lock "cinder-quobyte-31ec9585-ac91-4b01-ae36-0a6b7d0aac72" acquired by "delete_volume" :: waited 0.034s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:08:22 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[297e74fb-dcea-45d6-80e3-d3411d1fac16]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:08:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e54c6538-9cb6-45ec-ab50-30d381ddc5e4 tempest-TaggedAttachmentsTest-735790113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-31ec9585-ac91-4b01-ae36-0a6b7d0aac72 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:08:22 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-31ec9585-ac91-4b01-ae36-0a6b7d0aac72 Jun 29 11:08:22 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:08:23 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Jun 29 11:08:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e54c6538-9cb6-45ec-ab50-30d381ddc5e4 tempest-TaggedAttachmentsTest-735790113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-31ec9585-ac91-4b01-ae36-0a6b7d0aac72" returned: 0 in 1.398s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:08:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e54c6538-9cb6-45ec-ab50-30d381ddc5e4 tempest-TaggedAttachmentsTest-735790113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-31ec9585-ac91-4b01-ae36-0a6b7d0aac72 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:08:23 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-31ec9585-ac91-4b01-ae36-0a6b7d0aac72 Jun 29 11:08:23 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:08:24 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Jun 29 11:08:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e54c6538-9cb6-45ec-ab50-30d381ddc5e4 tempest-TaggedAttachmentsTest-735790113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-31ec9585-ac91-4b01-ae36-0a6b7d0aac72" returned: 0 in 1.241s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:08:24 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e54c6538-9cb6-45ec-ab50-30d381ddc5e4 tempest-TaggedAttachmentsTest-735790113 None] Lock "cinder-quobyte-31ec9585-ac91-4b01-ae36-0a6b7d0aac72" released by "delete_volume" :: held 2.741s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:08:24 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-e54c6538-9cb6-45ec-ab50-30d381ddc5e4 tempest-TaggedAttachmentsTest-735790113 None] Created reservations ['ddd08814-1503-4b11-90e7-92d3f7daafe6', '73a6af50-0dbc-4ed3-8672-8f3a02f26fc7', 'e0613033-72e6-4002-b386-f5ad9594b656', '3bff61b4-e2d3-4b44-a691-09ef10e22d93'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:08:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e54c6538-9cb6-45ec-ab50-30d381ddc5e4 tempest-TaggedAttachmentsTest-735790113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:08:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e54c6538-9cb6-45ec-ab50-30d381ddc5e4 tempest-TaggedAttachmentsTest-735790113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:08:25 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-e54c6538-9cb6-45ec-ab50-30d381ddc5e4 tempest-TaggedAttachmentsTest-735790113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:08:25 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-e54c6538-9cb6-45ec-ab50-30d381ddc5e4 tempest-TaggedAttachmentsTest-735790113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:08:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e54c6538-9cb6-45ec-ab50-30d381ddc5e4 tempest-TaggedAttachmentsTest-735790113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:08:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e54c6538-9cb6-45ec-ab50-30d381ddc5e4 tempest-TaggedAttachmentsTest-735790113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:08:25 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:08:25 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:08:26 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Jun 29 11:08:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e54c6538-9cb6-45ec-ab50-30d381ddc5e4 tempest-TaggedAttachmentsTest-735790113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.979s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:08:26 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-e54c6538-9cb6-45ec-ab50-30d381ddc5e4 tempest-TaggedAttachmentsTest-735790113 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:08:26 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-e54c6538-9cb6-45ec-ab50-30d381ddc5e4 tempest-TaggedAttachmentsTest-735790113 None] Deleted volume successfully. Jun 29 11:08:26 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e54c6538-9cb6-45ec-ab50-30d381ddc5e4 tempest-TaggedAttachmentsTest-735790113 None] Lock "cinder-31ec9585-ac91-4b01-ae36-0a6b7d0aac72-delete_volume" released by "delete_volume" :: held 4.147s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:08:33 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f5582ff9-5263-41e8-b6c4-623397c1d20a tempest-ServerActionsTestOtherA-772013197 None] Acquiring lock "cinder-c8dc1235-d3ab-4dfe-9b53-65bac30367b3-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:08:33 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f5582ff9-5263-41e8-b6c4-623397c1d20a tempest-ServerActionsTestOtherA-772013197 None] Lock "cinder-c8dc1235-d3ab-4dfe-9b53-65bac30367b3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:08:33 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f5582ff9-5263-41e8-b6c4-623397c1d20a tempest-ServerActionsTestOtherA-772013197 None] Acquiring lock "cinder-quobyte-c8dc1235-d3ab-4dfe-9b53-65bac30367b3" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:08:33 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f5582ff9-5263-41e8-b6c4-623397c1d20a tempest-ServerActionsTestOtherA-772013197 None] Lock "cinder-quobyte-c8dc1235-d3ab-4dfe-9b53-65bac30367b3" acquired by "delete_volume" :: waited 0.015s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:08:33 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[66412dfd-f1b0-473a-9f12-0eae090bd0fd]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:08:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f5582ff9-5263-41e8-b6c4-623397c1d20a tempest-ServerActionsTestOtherA-772013197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c8dc1235-d3ab-4dfe-9b53-65bac30367b3 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:08:33 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c8dc1235-d3ab-4dfe-9b53-65bac30367b3 Jun 29 11:08:33 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:08:35 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Jun 29 11:08:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f5582ff9-5263-41e8-b6c4-623397c1d20a tempest-ServerActionsTestOtherA-772013197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c8dc1235-d3ab-4dfe-9b53-65bac30367b3" returned: 0 in 1.401s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:08:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f5582ff9-5263-41e8-b6c4-623397c1d20a tempest-ServerActionsTestOtherA-772013197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c8dc1235-d3ab-4dfe-9b53-65bac30367b3 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:08:35 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c8dc1235-d3ab-4dfe-9b53-65bac30367b3 Jun 29 11:08:35 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:08:36 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Jun 29 11:08:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f5582ff9-5263-41e8-b6c4-623397c1d20a tempest-ServerActionsTestOtherA-772013197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c8dc1235-d3ab-4dfe-9b53-65bac30367b3" returned: 0 in 1.005s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:08:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f5582ff9-5263-41e8-b6c4-623397c1d20a tempest-ServerActionsTestOtherA-772013197 None] Lock "cinder-quobyte-c8dc1235-d3ab-4dfe-9b53-65bac30367b3" released by "delete_volume" :: held 2.469s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:08:36 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-f5582ff9-5263-41e8-b6c4-623397c1d20a tempest-ServerActionsTestOtherA-772013197 None] Created reservations ['7e547f75-6ff5-4217-bf2f-72eb50c6a8fd', '304b9eda-22d8-4ce4-8358-7824d8fe2d54', '976b761d-1b93-4288-90b5-5e23f1686189', 'fa802a8b-cc7f-4555-af0a-561aa151018a'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:08:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f5582ff9-5263-41e8-b6c4-623397c1d20a tempest-ServerActionsTestOtherA-772013197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:08:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f5582ff9-5263-41e8-b6c4-623397c1d20a tempest-ServerActionsTestOtherA-772013197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:08:36 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f5582ff9-5263-41e8-b6c4-623397c1d20a tempest-ServerActionsTestOtherA-772013197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:08:36 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f5582ff9-5263-41e8-b6c4-623397c1d20a tempest-ServerActionsTestOtherA-772013197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:08:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f5582ff9-5263-41e8-b6c4-623397c1d20a tempest-ServerActionsTestOtherA-772013197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:08:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f5582ff9-5263-41e8-b6c4-623397c1d20a tempest-ServerActionsTestOtherA-772013197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:08:36 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:08:36 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:08:37 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Jun 29 11:08:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f5582ff9-5263-41e8-b6c4-623397c1d20a tempest-ServerActionsTestOtherA-772013197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.991s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:08:37 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-f5582ff9-5263-41e8-b6c4-623397c1d20a tempest-ServerActionsTestOtherA-772013197 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:08:37 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-f5582ff9-5263-41e8-b6c4-623397c1d20a tempest-ServerActionsTestOtherA-772013197 None] Deleted volume successfully. Jun 29 11:08:37 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f5582ff9-5263-41e8-b6c4-623397c1d20a tempest-ServerActionsTestOtherA-772013197 None] Lock "cinder-c8dc1235-d3ab-4dfe-9b53-65bac30367b3-delete_volume" released by "delete_volume" :: held 3.793s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:08:43 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:08:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Flow 'volume_create_manager' (18e528da-e2d1-4050-905b-ba39c39a9917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:08:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (438594b1-e613-43a8-a589-e0b729eb2127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:08:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (438594b1-e613-43a8-a589-e0b729eb2127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1204426540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e9f157a-bf36-4b60-a138-86d5959cddbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4818890a904e4ce7939caf708df4a293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:08:43Z,use_quota=True,user_id='a16e074cce13467e9bd66e3b9d8b29c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:08:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f574fb6-b5e6-4c4a-b336-05095c784af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:08:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f574fb6-b5e6-4c4a-b336-05095c784af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:08:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c546ee-95ee-40f7-84ad-eeb35c376476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:08:43 devstack cinder-volume[93497]: DEBUG cinder.image.glance [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Creating Keystone auth plugin from conf {{(pid=93497) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 29 11:08:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c546ee-95ee-40f7-84ad-eeb35c376476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7e9f157a-bf36-4b60-a138-86d5959cddbe', 'volume_name': 'volume-7e9f157a-bf36-4b60-a138-86d5959cddbe', 'volume_size': 1, 'image_id': 'e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '376ed9c5d02d4ab0be650a3f1fd75615', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'created_at': datetime.datetime(2026, 6, 29, 8, 56, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 8, 56, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.sha256': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk'}}, 'image_service': }' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:08:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1bbbb9d-075d-4433-a24f-1fcd9a289829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:08:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1bbbb9d-075d-4433-a24f-1fcd9a289829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:08:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dfe081e-f46f-4e06-94c3-a2d57146ccf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:08:44 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Volume 7e9f157a-bf36-4b60-a138-86d5959cddbe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7e9f157a-bf36-4b60-a138-86d5959cddbe', 'volume_size': 1, 'image_id': 'e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '376ed9c5d02d4ab0be650a3f1fd75615', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'created_at': datetime.datetime(2026, 6, 29, 8, 56, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 8, 56, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.sha256': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk'}}, 'image_service': } Jun 29 11:08:44 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Trying to clone 7e9f157a-bf36-4b60-a138-86d5959cddbe from image e2b32301-75fb-4235-bdc7-d391d7ce88e1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'metadata': {}}]). {{(pid=93497) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 29 11:08:44 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_j3flw6yxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93497) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 29 11:08:44 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Image download 20.69 MB at 20.69 MB/s Jun 29 11:08:44 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8331234-2dbd-4ea3-a995-389db0de1af3]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:08:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_j3flw6yxdevstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:08:45 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_j3flw6yxdevstack@QuobyteHD Jun 29 11:08:45 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:08:45 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Jun 29 11:08:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_j3flw6yxdevstack@QuobyteHD" returned: 0 in 0.830s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:08:45 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Temporary image e2b32301-75fb-4235-bdc7-d391d7ce88e1 is fetched for user a16e074cce13467e9bd66e3b9d8b29c7. {{(pid=93497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 29 11:08:45 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c620b334-9545-456d-902f-6830bb196b5f]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:08:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_j3flw6yxdevstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:08:46 devstack sudo[98468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_j3flw6yxdevstack@QuobyteHD Jun 29 11:08:46 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:08:46 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root Jun 29 11:08:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_j3flw6yxdevstack@QuobyteHD" returned: 0 in 0.942s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:08:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:08:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:08:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1204426540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e9f157a-bf36-4b60-a138-86d5959cddbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4818890a904e4ce7939caf708df4a293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:08:43Z,use_quota=True,user_id='a16e074cce13467e9bd66e3b9d8b29c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:08:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Creating volume 7e9f157a-bf36-4b60-a138-86d5959cddbe {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:08:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:08:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:08:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:08:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:08:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:08:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:08:46 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:08:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7e9f157a-bf36-4b60-a138-86d5959cddbe 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:08:46 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7e9f157a-bf36-4b60-a138-86d5959cddbe 1073741824 Jun 29 11:08:46 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:08:48 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Jun 29 11:08:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7e9f157a-bf36-4b60-a138-86d5959cddbe 1073741824" returned: 0 in 1.178s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:08:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7e9f157a-bf36-4b60-a138-86d5959cddbe {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:08:48 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7e9f157a-bf36-4b60-a138-86d5959cddbe Jun 29 11:08:48 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:08:48 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Jun 29 11:08:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7e9f157a-bf36-4b60-a138-86d5959cddbe" returned: 0 in 0.736s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:08:48 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] <== create_volume: return (1979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:08:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.983s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:08:48 devstack cinder-volume[93497]: DEBUG cinder.volume.volume_utils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Attempting download of e2b32301-75fb-4235-bdc7-d391d7ce88e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'metadata': {}}])) to volume 7e9f157a-bf36-4b60-a138-86d5959cddbe. {{(pid=93497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 29 11:08:48 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cb6c7c-0796-4cfa-a95c-71bbcd7441ad]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:08:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2b32301-75fb-4235-bdc7-d391d7ce88e1_ul1dnhkv {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:08:49 devstack sudo[98485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2b32301-75fb-4235-bdc7-d391d7ce88e1_ul1dnhkv Jun 29 11:08:49 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:08:49 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root Jun 29 11:08:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2b32301-75fb-4235-bdc7-d391d7ce88e1_ul1dnhkv" returned: 0 in 1.069s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:08:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2b32301-75fb-4235-bdc7-d391d7ce88e1_ul1dnhkv {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:08:50 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2b32301-75fb-4235-bdc7-d391d7ce88e1_ul1dnhkv Jun 29 11:08:50 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:08:50 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:08:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] Flow 'volume_create_manager' (f91ccbc0-9640-4bf5-bb9e-adf08d7bf12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:08:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a4ef262-b551-463a-8419-d3a05025d458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:08:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a4ef262-b551-463a-8419-d3a05025d458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1641284440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c7098c0-87ec-451e-bee8-895c447844d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da80807f257487db4613eec5d620d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:08:50Z,use_quota=True,user_id='548fa465ec4e4401aaf62fbc335aee82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:08:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (742ecebd-45ec-4aac-8321-5a3ed08bb294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:08:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (742ecebd-45ec-4aac-8321-5a3ed08bb294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:08:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b2ea166-c844-4006-91b4-a054d077451f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:08:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b2ea166-c844-4006-91b4-a054d077451f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c7098c0-87ec-451e-bee8-895c447844d4', 'volume_name': 'volume-4c7098c0-87ec-451e-bee8-895c447844d4', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:08:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0828b5d-7293-4181-ad38-23ae519964f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:08:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0828b5d-7293-4181-ad38-23ae519964f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:08:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1fe5447-5e39-41e8-b5a2-3f95954b1f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:08:50 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] Volume 4c7098c0-87ec-451e-bee8-895c447844d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c7098c0-87ec-451e-bee8-895c447844d4', 'volume_size': 1} Jun 29 11:08:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:08:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:08:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1641284440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c7098c0-87ec-451e-bee8-895c447844d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da80807f257487db4613eec5d620d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:08:50Z,use_quota=True,user_id='548fa465ec4e4401aaf62fbc335aee82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:08:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] Creating volume 4c7098c0-87ec-451e-bee8-895c447844d4 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:08:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:08:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:08:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:08:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:08:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:08:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:08:50 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:08:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4c7098c0-87ec-451e-bee8-895c447844d4 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:08:50 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4c7098c0-87ec-451e-bee8-895c447844d4 1073741824 Jun 29 11:08:50 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:08:51 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Jun 29 11:08:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2b32301-75fb-4235-bdc7-d391d7ce88e1_ul1dnhkv" returned: 1 in 1.170s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:08:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2b32301-75fb-4235-bdc7-d391d7ce88e1_ul1dnhkv' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:08:51 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d441c93-f524-4bdb-9f77-09377a55ecb1]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:08:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_j3flw6yxdevstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:08:51 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_j3flw6yxdevstack@QuobyteHD Jun 29 11:08:51 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:08:52 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Jun 29 11:08:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4c7098c0-87ec-451e-bee8-895c447844d4 1073741824" returned: 0 in 1.284s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:08:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4c7098c0-87ec-451e-bee8-895c447844d4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:08:52 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4c7098c0-87ec-451e-bee8-895c447844d4 Jun 29 11:08:52 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:08:52 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root Jun 29 11:08:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_j3flw6yxdevstack@QuobyteHD" returned: 0 in 1.021s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:08:52 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] e2b32301-75fb-4235-bdc7-d391d7ce88e1 was qcow2, converting to raw {{(pid=93497) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 29 11:08:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_j3flw6yxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7e9f157a-bf36-4b60-a138-86d5959cddbe {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:08:52 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_j3flw6yxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7e9f157a-bf36-4b60-a138-86d5959cddbe Jun 29 11:08:52 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:08:53 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Jun 29 11:08:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4c7098c0-87ec-451e-bee8-895c447844d4" returned: 0 in 0.940s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:08:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] <== create_volume: return (2315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:08:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.318s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:08:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1fe5447-5e39-41e8-b5a2-3f95954b1f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c7098c0-87ec-451e-bee8-895c447844d4', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:08:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ee27f8-357c-4e32-96f2-048b383c38f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:08:53 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] Volume volume-4c7098c0-87ec-451e-bee8-895c447844d4 (4c7098c0-87ec-451e-bee8-895c447844d4): created successfully Jun 29 11:08:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ee27f8-357c-4e32-96f2-048b383c38f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:08:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] Flow 'volume_create_manager' (f91ccbc0-9640-4bf5-bb9e-adf08d7bf12f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:08:53 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-86b97701-b00a-4096-89f9-85cf4b680754 tempest-AttachVolumeShelveTestJSON-253942392 None] Created volume successfully. Jun 29 11:08:55 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Jun 29 11:08:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_j3flw6yxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7e9f157a-bf36-4b60-a138-86d5959cddbe" returned: 0 in 3.169s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:08:55 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_j3flw6yxdevstack@QuobyteHD, size 112.00 MB, duration 3.17 sec, destination /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7e9f157a-bf36-4b60-a138-86d5959cddbe {{(pid=93497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 11:08:55 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Converted 112.00 MB image at 35.33 MB/s Jun 29 11:08:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7e9f157a-bf36-4b60-a138-86d5959cddbe 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:08:55 devstack sudo[98529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7e9f157a-bf36-4b60-a138-86d5959cddbe 1G Jun 29 11:08:55 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:08:56 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root Jun 29 11:08:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7e9f157a-bf36-4b60-a138-86d5959cddbe 1G" returned: 0 in 0.974s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:08:56 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d441a0c-86b6-4e61-a71d-511217fb7b7d]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:08:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7e9f157a-bf36-4b60-a138-86d5959cddbe {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:08:56 devstack sudo[98534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7e9f157a-bf36-4b60-a138-86d5959cddbe Jun 29 11:08:56 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:08:57 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root Jun 29 11:08:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7e9f157a-bf36-4b60-a138-86d5959cddbe" returned: 0 in 1.232s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:08:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7e9f157a-bf36-4b60-a138-86d5959cddbe {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:08:57 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7e9f157a-bf36-4b60-a138-86d5959cddbe Jun 29 11:08:57 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:08:58 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Jun 29 11:08:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7e9f157a-bf36-4b60-a138-86d5959cddbe" returned: 1 in 1.037s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:08:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7e9f157a-bf36-4b60-a138-86d5959cddbe' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:08:58 devstack cinder-volume[93497]: DEBUG cinder.volume.volume_utils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Downloaded image e2b32301-75fb-4235-bdc7-d391d7ce88e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'metadata': {}}])) to volume 7e9f157a-bf36-4b60-a138-86d5959cddbe successfully. {{(pid=93497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 29 11:08:58 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Temporary image e2b32301-75fb-4235-bdc7-d391d7ce88e1 for user a16e074cce13467e9bd66e3b9d8b29c7 is deleted. {{(pid=93497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 29 11:08:58 devstack cinder-volume[93497]: DEBUG cinder.volume.volume_utils [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Marking volume 7e9f157a-bf36-4b60-a138-86d5959cddbe as bootable. {{(pid=93497) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 29 11:08:58 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Copying metadata from image e2b32301-75fb-4235-bdc7-d391d7ce88e1 to 7e9f157a-bf36-4b60-a138-86d5959cddbe. {{(pid=93497) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 29 11:08:58 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Creating volume glance metadata for volume 7e9f157a-bf36-4b60-a138-86d5959cddbe backed by image e2b32301-75fb-4235-bdc7-d391d7ce88e1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.sha256': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'image_id': 'e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93497) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 29 11:08:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dfe081e-f46f-4e06-94c3-a2d57146ccf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e9f157a-bf36-4b60-a138-86d5959cddbe', 'volume_size': 1, 'image_id': 'e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '376ed9c5d02d4ab0be650a3f1fd75615', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'created_at': datetime.datetime(2026, 6, 29, 8, 56, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 8, 56, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.sha256': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk'}}, 'image_service': }' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:08:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e22ddaa9-b7d4-4889-b5c4-6f2104f4aed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:08:58 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Volume volume-7e9f157a-bf36-4b60-a138-86d5959cddbe (7e9f157a-bf36-4b60-a138-86d5959cddbe): created successfully Jun 29 11:08:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e22ddaa9-b7d4-4889-b5c4-6f2104f4aed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:08:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Flow 'volume_create_manager' (18e528da-e2d1-4050-905b-ba39c39a9917) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:08:58 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-989d2491-0e3a-4e8b-ab7d-8681be08e6d4 tempest-VolumesImageMetadata-1123113063 None] Created volume successfully. Jun 29 11:08:59 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c55d555c-859d-4ece-b0fb-1820b10e623d tempest-VolumesImageMetadata-1123113063 None] Acquiring lock "cinder-7e9f157a-bf36-4b60-a138-86d5959cddbe-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:08:59 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c55d555c-859d-4ece-b0fb-1820b10e623d tempest-VolumesImageMetadata-1123113063 None] Lock "cinder-7e9f157a-bf36-4b60-a138-86d5959cddbe-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:08:59 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c55d555c-859d-4ece-b0fb-1820b10e623d tempest-VolumesImageMetadata-1123113063 None] Acquiring lock "cinder-quobyte-7e9f157a-bf36-4b60-a138-86d5959cddbe" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:08:59 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c55d555c-859d-4ece-b0fb-1820b10e623d tempest-VolumesImageMetadata-1123113063 None] Lock "cinder-quobyte-7e9f157a-bf36-4b60-a138-86d5959cddbe" acquired by "delete_volume" :: waited 0.016s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:08:59 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0277b3e-2294-46a4-8942-cf9bf8ecd0ce]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:08:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c55d555c-859d-4ece-b0fb-1820b10e623d tempest-VolumesImageMetadata-1123113063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7e9f157a-bf36-4b60-a138-86d5959cddbe {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:00 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7e9f157a-bf36-4b60-a138-86d5959cddbe Jun 29 11:09:00 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:00 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c55d555c-859d-4ece-b0fb-1820b10e623d tempest-VolumesImageMetadata-1123113063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7e9f157a-bf36-4b60-a138-86d5959cddbe" returned: 0 in 1.025s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c55d555c-859d-4ece-b0fb-1820b10e623d tempest-VolumesImageMetadata-1123113063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7e9f157a-bf36-4b60-a138-86d5959cddbe {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:01 devstack sudo[98594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7e9f157a-bf36-4b60-a138-86d5959cddbe Jun 29 11:09:01 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:01 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c55d555c-859d-4ece-b0fb-1820b10e623d tempest-VolumesImageMetadata-1123113063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7e9f157a-bf36-4b60-a138-86d5959cddbe" returned: 1 in 0.927s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c55d555c-859d-4ece-b0fb-1820b10e623d tempest-VolumesImageMetadata-1123113063 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7e9f157a-bf36-4b60-a138-86d5959cddbe' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:09:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c55d555c-859d-4ece-b0fb-1820b10e623d tempest-VolumesImageMetadata-1123113063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7e9f157a-bf36-4b60-a138-86d5959cddbe {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:01 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7e9f157a-bf36-4b60-a138-86d5959cddbe Jun 29 11:09:01 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:02 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c55d555c-859d-4ece-b0fb-1820b10e623d tempest-VolumesImageMetadata-1123113063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7e9f157a-bf36-4b60-a138-86d5959cddbe" returned: 0 in 1.047s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:02 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c55d555c-859d-4ece-b0fb-1820b10e623d tempest-VolumesImageMetadata-1123113063 None] Lock "cinder-quobyte-7e9f157a-bf36-4b60-a138-86d5959cddbe" released by "delete_volume" :: held 3.100s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:09:03 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-c55d555c-859d-4ece-b0fb-1820b10e623d tempest-VolumesImageMetadata-1123113063 None] Created reservations ['fa6ef948-31b7-4e6b-802e-41dc081b33f2', '7f8685ec-a113-491f-8a30-851588392179', '62545c1e-65f0-4d4f-be89-2ee114c30af7', '969b27dd-fdde-4777-8b81-cb1bc2910603'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:09:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c55d555c-859d-4ece-b0fb-1820b10e623d tempest-VolumesImageMetadata-1123113063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:09:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c55d555c-859d-4ece-b0fb-1820b10e623d tempest-VolumesImageMetadata-1123113063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:09:03 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c55d555c-859d-4ece-b0fb-1820b10e623d tempest-VolumesImageMetadata-1123113063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:09:03 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c55d555c-859d-4ece-b0fb-1820b10e623d tempest-VolumesImageMetadata-1123113063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:09:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c55d555c-859d-4ece-b0fb-1820b10e623d tempest-VolumesImageMetadata-1123113063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:09:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c55d555c-859d-4ece-b0fb-1820b10e623d tempest-VolumesImageMetadata-1123113063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:03 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:09:03 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:04 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c55d555c-859d-4ece-b0fb-1820b10e623d tempest-VolumesImageMetadata-1123113063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.057s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:04 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-c55d555c-859d-4ece-b0fb-1820b10e623d tempest-VolumesImageMetadata-1123113063 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:09:04 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-c55d555c-859d-4ece-b0fb-1820b10e623d tempest-VolumesImageMetadata-1123113063 None] Deleted volume successfully. Jun 29 11:09:04 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c55d555c-859d-4ece-b0fb-1820b10e623d tempest-VolumesImageMetadata-1123113063 None] Lock "cinder-7e9f157a-bf36-4b60-a138-86d5959cddbe-delete_volume" released by "delete_volume" :: held 4.521s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:09:07 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:09:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:09:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:09:07 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:09:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:09:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:09:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:08 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:09:08 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:09 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.157s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:09 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:09:09 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager._thread_info {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:09:09 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread count: 28 {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 11:09:09 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread info: [<_MainThread(MainThread, started 131117520400512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 11:09:10 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:09:10 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] Flow 'volume_create_manager' (06c7b90f-2bcf-4f9f-96af-6e9ec1939ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:09:10 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a5b5f4-3752-48c0-ae80-4be3ae3ca0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:09:10 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a5b5f4-3752-48c0-ae80-4be3ae3ca0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1091374246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b7814a-5e57-48f6-8376-29ebd694d500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efd9490cd26a4da2b50cde11c45cb256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:09:10Z,use_quota=True,user_id='65acb7b87ce947189662a3d5f024699b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:09:10 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb890d9-e2bb-422c-833d-e557d62d6473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:09:10 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb890d9-e2bb-422c-833d-e557d62d6473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:09:10 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28c8cfa-3f3d-4621-a80d-6bc8e695ba00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:09:10 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28c8cfa-3f3d-4621-a80d-6bc8e695ba00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67b7814a-5e57-48f6-8376-29ebd694d500', 'volume_name': 'volume-67b7814a-5e57-48f6-8376-29ebd694d500', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:09:10 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d3c542-019a-4665-855b-5a9c1ea8f65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:09:10 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d3c542-019a-4665-855b-5a9c1ea8f65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:09:10 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d81c93-6f9e-484d-a4e2-93d076d943ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:09:10 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] Volume 67b7814a-5e57-48f6-8376-29ebd694d500: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67b7814a-5e57-48f6-8376-29ebd694d500', 'volume_size': 1} Jun 29 11:09:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:09:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:09:10 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1091374246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b7814a-5e57-48f6-8376-29ebd694d500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efd9490cd26a4da2b50cde11c45cb256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:09:10Z,use_quota=True,user_id='65acb7b87ce947189662a3d5f024699b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:09:10 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] Creating volume 67b7814a-5e57-48f6-8376-29ebd694d500 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:09:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:09:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:09:10 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:09:10 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:09:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:09:10 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:09:10 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:09:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:10 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500 1073741824 Jun 29 11:09:10 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:11 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500 1073741824" returned: 0 in 1.230s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:11 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500 Jun 29 11:09:11 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:12 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500" returned: 0 in 0.890s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:12 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] <== create_volume: return (2203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:09:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.209s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:09:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d81c93-6f9e-484d-a4e2-93d076d943ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67b7814a-5e57-48f6-8376-29ebd694d500', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:09:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (787fb8fd-de6a-4ff2-9174-ff97f9f6cce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:09:12 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] Volume volume-67b7814a-5e57-48f6-8376-29ebd694d500 (67b7814a-5e57-48f6-8376-29ebd694d500): created successfully Jun 29 11:09:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (787fb8fd-de6a-4ff2-9174-ff97f9f6cce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:09:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] Flow 'volume_create_manager' (06c7b90f-2bcf-4f9f-96af-6e9ec1939ad3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:09:12 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-a4b7c01d-8a83-4fb8-b45a-b45f7b127166 tempest-VolumesDeleteCascade-940584758 None] Created volume successfully. Jun 29 11:09:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8908d052-c0fa-4a10-b3a5-e8a4ac827b44 tempest-VolumesDeleteCascade-940584758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:09:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8908d052-c0fa-4a10-b3a5-e8a4ac827b44 tempest-VolumesDeleteCascade-940584758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:09:14 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-8908d052-c0fa-4a10-b3a5-e8a4ac827b44 tempest-VolumesDeleteCascade-940584758 None] Creating offline snapshot b2149647-6354-4240-b0af-b6687c3fa1dd of volume 67b7814a-5e57-48f6-8376-29ebd694d500 {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:09:14 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1313526-495e-475e-8b49-3d6688b03d2d]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:09:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8908d052-c0fa-4a10-b3a5-e8a4ac827b44 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:14 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500 Jun 29 11:09:14 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:15 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8908d052-c0fa-4a10-b3a5-e8a4ac827b44 tempest-VolumesDeleteCascade-940584758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500" returned: 0 in 0.976s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8908d052-c0fa-4a10-b3a5-e8a4ac827b44 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:15 devstack sudo[98652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd 1G Jun 29 11:09:15 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:16 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8908d052-c0fa-4a10-b3a5-e8a4ac827b44 tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd 1G" returned: 0 in 1.377s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8908d052-c0fa-4a10-b3a5-e8a4ac827b44 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67b7814a-5e57-48f6-8376-29ebd694d500 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:16 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67b7814a-5e57-48f6-8376-29ebd694d500 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd Jun 29 11:09:16 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:17 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8908d052-c0fa-4a10-b3a5-e8a4ac827b44 tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67b7814a-5e57-48f6-8376-29ebd694d500 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd" returned: 0 in 0.789s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:17 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-8908d052-c0fa-4a10-b3a5-e8a4ac827b44 tempest-VolumesDeleteCascade-940584758 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd is being set with open permissions: ugo+rw Jun 29 11:09:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8908d052-c0fa-4a10-b3a5-e8a4ac827b44 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:17 devstack sudo[98671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd Jun 29 11:09:17 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:18 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=28,cinder:INSERT=8,cinder:UPDATE=41,cinder:DELETE=4 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:09:18 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-b062ff1c-98e7-4b47-aa14-56c7e932ea8d req-daa5ed48-5748-4d8a-b40d-f06e4b6b9644 tempest-AttachVolumeShelveTestJSON-253942392 None] No connector for attachment 7edd65c5-cfe2-42c7-a4dd-cd8cbd2fb8f6; skipping storage backend terminate_connection call. {{(pid=93497) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 29 11:09:18 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-b062ff1c-98e7-4b47-aa14-56c7e932ea8d req-daa5ed48-5748-4d8a-b40d-f06e4b6b9644 tempest-AttachVolumeShelveTestJSON-253942392 None] Deleting attachment 7edd65c5-cfe2-42c7-a4dd-cd8cbd2fb8f6. {{(pid=93497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 11:09:18 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8908d052-c0fa-4a10-b3a5-e8a4ac827b44 tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd" returned: 0 in 0.882s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:18 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=37,cinder:UPDATE=30,cinder:INSERT=20,cinder:DELETE=2 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:09:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8908d052-c0fa-4a10-b3a5-e8a4ac827b44 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:18 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.info Jun 29 11:09:18 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:19 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8908d052-c0fa-4a10-b3a5-e8a4ac827b44 tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.info" returned: 0 in 0.827s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:19 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-8908d052-c0fa-4a10-b3a5-e8a4ac827b44 tempest-VolumesDeleteCascade-940584758 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.info is being set with open permissions: ugo+rw Jun 29 11:09:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8908d052-c0fa-4a10-b3a5-e8a4ac827b44 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:19 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.info Jun 29 11:09:19 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:19 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8908d052-c0fa-4a10-b3a5-e8a4ac827b44 tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.info" returned: 0 in 0.887s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8908d052-c0fa-4a10-b3a5-e8a4ac827b44 tempest-VolumesDeleteCascade-940584758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.901s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:09:20 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-8908d052-c0fa-4a10-b3a5-e8a4ac827b44 tempest-VolumesDeleteCascade-940584758 None] Create snapshot completed successfully Jun 29 11:09:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e8ae567a-848a-4f65-8044-7833f3703fcc tempest-VolumesDeleteCascade-940584758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:09:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e8ae567a-848a-4f65-8044-7833f3703fcc tempest-VolumesDeleteCascade-940584758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:09:20 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-e8ae567a-848a-4f65-8044-7833f3703fcc tempest-VolumesDeleteCascade-940584758 None] Creating offline snapshot 79e5abe1-108f-4eec-aeeb-3c2a02e2e124 of volume 67b7814a-5e57-48f6-8376-29ebd694d500 {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:09:20 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c77e9c-639b-44b8-836f-882aee81a30a]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:09:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e8ae567a-848a-4f65-8044-7833f3703fcc tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:20 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd Jun 29 11:09:20 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:22 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e8ae567a-848a-4f65-8044-7833f3703fcc tempest-VolumesDeleteCascade-940584758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd" returned: 0 in 1.354s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:22 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-e8ae567a-848a-4f65-8044-7833f3703fcc tempest-VolumesDeleteCascade-940584758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67b7814a-5e57-48f6-8376-29ebd694d500(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:09:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e8ae567a-848a-4f65-8044-7833f3703fcc tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.79e5abe1-108f-4eec-aeeb-3c2a02e2e124 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:22 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.79e5abe1-108f-4eec-aeeb-3c2a02e2e124 1G Jun 29 11:09:22 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:23 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e8ae567a-848a-4f65-8044-7833f3703fcc tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.79e5abe1-108f-4eec-aeeb-3c2a02e2e124 1G" returned: 0 in 1.847s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e8ae567a-848a-4f65-8044-7833f3703fcc tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.79e5abe1-108f-4eec-aeeb-3c2a02e2e124 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:24 devstack sudo[98793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.79e5abe1-108f-4eec-aeeb-3c2a02e2e124 Jun 29 11:09:24 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:25 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e8ae567a-848a-4f65-8044-7833f3703fcc tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.79e5abe1-108f-4eec-aeeb-3c2a02e2e124" returned: 0 in 1.368s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:25 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-e8ae567a-848a-4f65-8044-7833f3703fcc tempest-VolumesDeleteCascade-940584758 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.79e5abe1-108f-4eec-aeeb-3c2a02e2e124 is being set with open permissions: ugo+rw Jun 29 11:09:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e8ae567a-848a-4f65-8044-7833f3703fcc tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.79e5abe1-108f-4eec-aeeb-3c2a02e2e124 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:25 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.79e5abe1-108f-4eec-aeeb-3c2a02e2e124 Jun 29 11:09:25 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:26 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e8ae567a-848a-4f65-8044-7833f3703fcc tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.79e5abe1-108f-4eec-aeeb-3c2a02e2e124" returned: 0 in 1.041s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e8ae567a-848a-4f65-8044-7833f3703fcc tempest-VolumesDeleteCascade-940584758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.797s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:09:26 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-e8ae567a-848a-4f65-8044-7833f3703fcc tempest-VolumesDeleteCascade-940584758 None] Create snapshot completed successfully Jun 29 11:09:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Acquiring lock "cinder-67b7814a-5e57-48f6-8376-29ebd694d500-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:09:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-67b7814a-5e57-48f6-8376-29ebd694d500-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:09:27 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Performing cascade delete. {{(pid=93497) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 29 11:09:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Acquiring lock "cinder-79e5abe1-108f-4eec-aeeb-3c2a02e2e124-delete_snapshot" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:09:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-79e5abe1-108f-4eec-aeeb-3c2a02e2e124-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:09:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Acquiring lock "cinder-quobyte-67b7814a-5e57-48f6-8376-29ebd694d500" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:09:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-quobyte-67b7814a-5e57-48f6-8376-29ebd694d500" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:09:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Acquiring lock "cinder-quobyte-79e5abe1-108f-4eec-aeeb-3c2a02e2e124" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:09:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-quobyte-79e5abe1-108f-4eec-aeeb-3c2a02e2e124" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:09:27 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Deleting offline snapshot 79e5abe1-108f-4eec-aeeb-3c2a02e2e124 of volume 67b7814a-5e57-48f6-8376-29ebd694d500 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:09:27 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] snapshot_file for this snap is: volume-67b7814a-5e57-48f6-8376-29ebd694d500.79e5abe1-108f-4eec-aeeb-3c2a02e2e124 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:09:27 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bc165f-9ac3-46c7-a81f-31ddd9f4c462]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:09:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.79e5abe1-108f-4eec-aeeb-3c2a02e2e124 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:27 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.79e5abe1-108f-4eec-aeeb-3c2a02e2e124 Jun 29 11:09:27 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:29 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.79e5abe1-108f-4eec-aeeb-3c2a02e2e124" returned: 0 in 1.268s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:29 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67b7814a-5e57-48f6-8376-29ebd694d500(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:09:29 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[009b39e6-8d90-4232-95d4-427cce7e2776]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:09:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:29 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd Jun 29 11:09:29 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:30 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd" returned: 0 in 0.966s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:30 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67b7814a-5e57-48f6-8376-29ebd694d500(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:09:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.79e5abe1-108f-4eec-aeeb-3c2a02e2e124 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:30 devstack sudo[98818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.79e5abe1-108f-4eec-aeeb-3c2a02e2e124 Jun 29 11:09:30 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:31 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.79e5abe1-108f-4eec-aeeb-3c2a02e2e124" returned: 0 in 1.187s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.79e5abe1-108f-4eec-aeeb-3c2a02e2e124 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:31 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.79e5abe1-108f-4eec-aeeb-3c2a02e2e124 Jun 29 11:09:31 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:32 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.79e5abe1-108f-4eec-aeeb-3c2a02e2e124" returned: 0 in 1.222s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:32 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-quobyte-79e5abe1-108f-4eec-aeeb-3c2a02e2e124" released by "_delete_snapshot" :: held 4.832s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:09:32 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-quobyte-67b7814a-5e57-48f6-8376-29ebd694d500" released by "delete_snapshot" :: held 4.868s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:09:32 devstack cinder-volume[93497]: WARNING cinder.quota [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:09:32 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Created reservations ['9d359ed1-247b-4fad-a3d6-0ae70169b6a1', 'ee2b8b97-2bb7-40e3-aac7-8812fed3e8b2', '56fd87f3-6754-42c2-ac46-a0fa7fa402c1', 'e97ba747-ea79-4d14-866a-9fba43ed25f8'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:09:32 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Delete snapshot completed successfully. Jun 29 11:09:32 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-79e5abe1-108f-4eec-aeeb-3c2a02e2e124-delete_snapshot" released by "delete_snapshot" :: held 5.082s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:09:32 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Acquiring lock "cinder-b2149647-6354-4240-b0af-b6687c3fa1dd-delete_snapshot" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:09:32 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-b2149647-6354-4240-b0af-b6687c3fa1dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:09:32 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Acquiring lock "cinder-quobyte-67b7814a-5e57-48f6-8376-29ebd694d500" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:09:32 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-quobyte-67b7814a-5e57-48f6-8376-29ebd694d500" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:09:32 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Acquiring lock "cinder-quobyte-b2149647-6354-4240-b0af-b6687c3fa1dd" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:09:32 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-quobyte-b2149647-6354-4240-b0af-b6687c3fa1dd" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:09:32 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Deleting offline snapshot b2149647-6354-4240-b0af-b6687c3fa1dd of volume 67b7814a-5e57-48f6-8376-29ebd694d500 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:09:32 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] snapshot_file for this snap is: volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:09:32 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6519a694-7ec4-4d1c-975a-0800afb9a70f]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:09:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:33 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd Jun 29 11:09:33 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:33 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd" returned: 0 in 1.117s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:33 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67b7814a-5e57-48f6-8376-29ebd694d500(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:09:34 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb882e87-2469-4c2d-bb49-59152d673ac6]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:09:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:34 devstack sudo[98860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500 Jun 29 11:09:34 devstack sudo[98860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:35 devstack sudo[98860]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500" returned: 0 in 1.276s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:35 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd Jun 29 11:09:35 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:37 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd" returned: 0 in 2.380s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:37 devstack sudo[98980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd Jun 29 11:09:37 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:38 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500.b2149647-6354-4240-b0af-b6687c3fa1dd" returned: 0 in 1.022s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:38 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-quobyte-b2149647-6354-4240-b0af-b6687c3fa1dd" released by "_delete_snapshot" :: held 5.944s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:09:38 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-quobyte-67b7814a-5e57-48f6-8376-29ebd694d500" released by "delete_snapshot" :: held 5.975s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:09:38 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Created reservations ['d72a615f-e409-4919-95b7-5302eb6fa960', 'caff597d-5e2f-4f58-b8d2-a37dfdfb650d', '267fa0d2-1a05-4a3d-820e-9489c38d8c13', '8440e0ab-004d-4940-949c-a83d29967062'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:09:38 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Delete snapshot completed successfully. Jun 29 11:09:38 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-b2149647-6354-4240-b0af-b6687c3fa1dd-delete_snapshot" released by "delete_snapshot" :: held 6.229s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:09:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Snapshots deleted, issuing volume delete {{(pid=93497) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 29 11:09:38 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Acquiring lock "cinder-quobyte-67b7814a-5e57-48f6-8376-29ebd694d500" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:09:39 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-quobyte-67b7814a-5e57-48f6-8376-29ebd694d500" acquired by "delete_volume" :: waited 0.025s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:09:39 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfed3e8-bb86-48c1-bb96-a44c2675045b]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:09:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:39 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500 Jun 29 11:09:39 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:40 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500" returned: 0 in 1.144s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:40 devstack sudo[98992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500 Jun 29 11:09:40 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:40 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-67b7814a-5e57-48f6-8376-29ebd694d500" returned: 0 in 0.694s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:40 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-quobyte-67b7814a-5e57-48f6-8376-29ebd694d500" released by "delete_volume" :: held 1.907s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:09:41 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Created reservations ['673c55ee-12e0-4eff-8c5a-da9e95d2a109', 'e953f06a-e9b5-488f-b87c-ba9f00bdf301', '9378d523-6cd0-4666-9d25-20274a14ee21', 'e9c5b4e3-70e3-458f-a213-95c949233484'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:09:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:09:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:09:41 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:09:41 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:09:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:09:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:41 devstack sudo[98999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:09:41 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:42 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.441s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:42 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:09:42 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Deleted volume successfully. Jun 29 11:09:42 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-81d5c259-d751-4ff4-8231-1caad563d912 tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-67b7814a-5e57-48f6-8376-29ebd694d500-delete_volume" released by "delete_volume" :: held 15.181s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:09:43 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:09:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] Flow 'volume_create_manager' (0b985184-b610-40e2-9fe3-3f162f165aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:09:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6d33e9-7139-4aca-b55c-5cdc0a0ede48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:09:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6d33e9-7139-4aca-b55c-5cdc0a0ede48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1114399932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f58ece7-ad53-4381-8656-73e3d933f10a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efd9490cd26a4da2b50cde11c45cb256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:09:43Z,use_quota=True,user_id='65acb7b87ce947189662a3d5f024699b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:09:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96117abe-82b9-4600-90fb-cfe737d5a46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:09:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96117abe-82b9-4600-90fb-cfe737d5a46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:09:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e4605ae-1d12-4f41-8b12-46c6ee86b6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:09:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e4605ae-1d12-4f41-8b12-46c6ee86b6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f58ece7-ad53-4381-8656-73e3d933f10a', 'volume_name': 'volume-6f58ece7-ad53-4381-8656-73e3d933f10a', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:09:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0727ee9e-6cdc-475a-a4cf-6dc3aa3adec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:09:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0727ee9e-6cdc-475a-a4cf-6dc3aa3adec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:09:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64340370-c707-48a2-beb3-8fe013b1204c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:09:43 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] Volume 6f58ece7-ad53-4381-8656-73e3d933f10a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f58ece7-ad53-4381-8656-73e3d933f10a', 'volume_size': 1} Jun 29 11:09:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:09:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:09:43 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1114399932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f58ece7-ad53-4381-8656-73e3d933f10a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efd9490cd26a4da2b50cde11c45cb256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:09:43Z,use_quota=True,user_id='65acb7b87ce947189662a3d5f024699b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:09:43 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] Creating volume 6f58ece7-ad53-4381-8656-73e3d933f10a {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:09:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:09:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:09:43 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:09:43 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:09:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:09:43 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:09:43 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:09:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:43 devstack sudo[99072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a 1073741824 Jun 29 11:09:43 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:45 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a 1073741824" returned: 0 in 2.444s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:46 devstack sudo[99123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a Jun 29 11:09:46 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:48 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a" returned: 0 in 2.126s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:48 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] <== create_volume: return (4755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:09:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.759s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:09:48 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64340370-c707-48a2-beb3-8fe013b1204c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f58ece7-ad53-4381-8656-73e3d933f10a', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:09:48 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43be112b-eed7-489d-bb93-c55e489a81fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:09:48 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] Volume volume-6f58ece7-ad53-4381-8656-73e3d933f10a (6f58ece7-ad53-4381-8656-73e3d933f10a): created successfully Jun 29 11:09:48 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43be112b-eed7-489d-bb93-c55e489a81fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:09:48 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] Flow 'volume_create_manager' (0b985184-b610-40e2-9fe3-3f162f165aab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:09:48 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-5d2285ed-42f9-4e36-b0fa-77f152c8b5c8 tempest-VolumesDeleteCascade-940584758 None] Created volume successfully. Jun 29 11:09:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-6a5274ae-f65d-426f-9c37-3281c293d5f0 tempest-VolumesDeleteCascade-940584758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:09:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-6a5274ae-f65d-426f-9c37-3281c293d5f0 tempest-VolumesDeleteCascade-940584758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:09:49 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-6a5274ae-f65d-426f-9c37-3281c293d5f0 tempest-VolumesDeleteCascade-940584758 None] Creating offline snapshot 24e22158-f3f1-4425-a892-dd27ad956dc1 of volume 6f58ece7-ad53-4381-8656-73e3d933f10a {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:09:49 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5d844a-060c-430d-929b-3f129071db26]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:09:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6a5274ae-f65d-426f-9c37-3281c293d5f0 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:49 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a Jun 29 11:09:49 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:50 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:09:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] Flow 'volume_create_manager' (b8ae5da1-3c36-4055-814d-7f5dc99fa572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:09:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e5ab0f-b11b-4d0c-b4a8-0bb6606c5513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:09:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e5ab0f-b11b-4d0c-b4a8-0bb6606c5513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1351331689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adc25e7b-bded-4e76-afee-697e786a20ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b96039928714c9b8c189bae3e1da70b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:09:50Z,use_quota=True,user_id='a6222c2687a041d18d5c1bb5ef11d4f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:09:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23329f14-cdad-47b6-a788-8cae64e47002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:09:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23329f14-cdad-47b6-a788-8cae64e47002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:09:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44a16489-fbb7-4a5b-9e96-c41291232b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:09:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44a16489-fbb7-4a5b-9e96-c41291232b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adc25e7b-bded-4e76-afee-697e786a20ef', 'volume_name': 'volume-adc25e7b-bded-4e76-afee-697e786a20ef', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:09:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed5894b-b180-4f57-87c1-6e65c33a9ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:09:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed5894b-b180-4f57-87c1-6e65c33a9ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:09:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f43cb253-2dac-4248-8cf9-eb5ac7a1441c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:09:50 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] Volume adc25e7b-bded-4e76-afee-697e786a20ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adc25e7b-bded-4e76-afee-697e786a20ef', 'volume_size': 1} Jun 29 11:09:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:09:50 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6a5274ae-f65d-426f-9c37-3281c293d5f0 tempest-VolumesDeleteCascade-940584758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a" returned: 0 in 1.317s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6a5274ae-f65d-426f-9c37-3281c293d5f0 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a.24e22158-f3f1-4425-a892-dd27ad956dc1 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:50 devstack sudo[99157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a.24e22158-f3f1-4425-a892-dd27ad956dc1 1G Jun 29 11:09:50 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:51 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6a5274ae-f65d-426f-9c37-3281c293d5f0 tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a.24e22158-f3f1-4425-a892-dd27ad956dc1 1G" returned: 0 in 1.030s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6a5274ae-f65d-426f-9c37-3281c293d5f0 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f58ece7-ad53-4381-8656-73e3d933f10a -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a.24e22158-f3f1-4425-a892-dd27ad956dc1 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:51 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f58ece7-ad53-4381-8656-73e3d933f10a -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a.24e22158-f3f1-4425-a892-dd27ad956dc1 Jun 29 11:09:51 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:52 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6a5274ae-f65d-426f-9c37-3281c293d5f0 tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f58ece7-ad53-4381-8656-73e3d933f10a -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a.24e22158-f3f1-4425-a892-dd27ad956dc1" returned: 0 in 0.845s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:52 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-6a5274ae-f65d-426f-9c37-3281c293d5f0 tempest-VolumesDeleteCascade-940584758 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a.24e22158-f3f1-4425-a892-dd27ad956dc1 is being set with open permissions: ugo+rw Jun 29 11:09:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6a5274ae-f65d-426f-9c37-3281c293d5f0 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a.24e22158-f3f1-4425-a892-dd27ad956dc1 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:52 devstack sudo[99205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a.24e22158-f3f1-4425-a892-dd27ad956dc1 Jun 29 11:09:52 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:53 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6a5274ae-f65d-426f-9c37-3281c293d5f0 tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a.24e22158-f3f1-4425-a892-dd27ad956dc1" returned: 0 in 0.720s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6a5274ae-f65d-426f-9c37-3281c293d5f0 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:53 devstack sudo[99208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a.info Jun 29 11:09:53 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:54 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6a5274ae-f65d-426f-9c37-3281c293d5f0 tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a.info" returned: 0 in 0.820s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:54 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-6a5274ae-f65d-426f-9c37-3281c293d5f0 tempest-VolumesDeleteCascade-940584758 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a.info is being set with open permissions: ugo+rw Jun 29 11:09:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6a5274ae-f65d-426f-9c37-3281c293d5f0 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:54 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a.info Jun 29 11:09:54 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:55 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6a5274ae-f65d-426f-9c37-3281c293d5f0 tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a.info" returned: 0 in 0.779s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-6a5274ae-f65d-426f-9c37-3281c293d5f0 tempest-VolumesDeleteCascade-940584758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.700s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:09:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:09:55 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1351331689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adc25e7b-bded-4e76-afee-697e786a20ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b96039928714c9b8c189bae3e1da70b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:09:50Z,use_quota=True,user_id='a6222c2687a041d18d5c1bb5ef11d4f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:09:55 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] Creating volume adc25e7b-bded-4e76-afee-697e786a20ef {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:09:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:09:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:09:55 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:09:55 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:09:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:09:55 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:09:55 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:09:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-adc25e7b-bded-4e76-afee-697e786a20ef 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:55 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-adc25e7b-bded-4e76-afee-697e786a20ef 1073741824 Jun 29 11:09:55 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:55 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-6a5274ae-f65d-426f-9c37-3281c293d5f0 tempest-VolumesDeleteCascade-940584758 None] Create snapshot completed successfully Jun 29 11:09:56 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-adc25e7b-bded-4e76-afee-697e786a20ef 1073741824" returned: 0 in 1.164s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-adc25e7b-bded-4e76-afee-697e786a20ef {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:56 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-adc25e7b-bded-4e76-afee-697e786a20ef Jun 29 11:09:56 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:56 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:09:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Flow 'volume_create_manager' (42f7b1f8-15d5-46fe-bf60-9dc7623ba2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:09:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc82e4b-2255-4f0b-b900-4e925a97c9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:09:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc82e4b-2255-4f0b-b900-4e925a97c9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1672507812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efd9490cd26a4da2b50cde11c45cb256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=24e22158-f3f1-4425-a892-dd27ad956dc1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:09:57Z,use_quota=True,user_id='65acb7b87ce947189662a3d5f024699b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:09:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4bdf2c9-3ebd-4866-bc12-7664dd11779e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:09:57 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4bdf2c9-3ebd-4866-bc12-7664dd11779e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:09:57 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cbad0e1-e7db-48b4-94fc-afaa8ded4b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:09:57 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cbad0e1-e7db-48b4-94fc-afaa8ded4b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d', 'volume_name': 'volume-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d', 'volume_size': 1, 'snapshot_id': '24e22158-f3f1-4425-a892-dd27ad956dc1'}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:09:57 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db2de633-6e45-4018-a4b6-a694e398d3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:09:57 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db2de633-6e45-4018-a4b6-a694e398d3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:09:57 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d800d44-6121-4eda-af53-39d54ef520fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:09:57 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Volume ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d', 'volume_size': 1, 'snapshot_id': '24e22158-f3f1-4425-a892-dd27ad956dc1'} Jun 29 11:09:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:09:57 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-adc25e7b-bded-4e76-afee-697e786a20ef" returned: 0 in 1.456s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:57 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] <== create_volume: return (2691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:09:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.694s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:09:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.819s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:09:57 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Acquiring lock "cinder-quobyte-24e22158-f3f1-4425-a892-dd27ad956dc1-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d" by "_create_volume_from_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:09:57 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f43cb253-2dac-4248-8cf9-eb5ac7a1441c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adc25e7b-bded-4e76-afee-697e786a20ef', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:09:57 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ca2fa71-ddfb-46ae-84c6-d48826f5ed3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:09:57 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-quobyte-24e22158-f3f1-4425-a892-dd27ad956dc1-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d" acquired by "_create_volume_from_snapshot" :: waited 0.080s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:09:57 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Creating volume ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d from snapshot 24e22158-f3f1-4425-a892-dd27ad956dc1 {{(pid=93497) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 29 11:09:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:09:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:09:57 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:09:57 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:09:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:09:57 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:09:57 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Acquiring lock "cinder-quobyte-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d" by "_copy_volume_from_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:09:57 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] Volume volume-adc25e7b-bded-4e76-afee-697e786a20ef (adc25e7b-bded-4e76-afee-697e786a20ef): created successfully Jun 29 11:09:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ca2fa71-ddfb-46ae-84c6-d48826f5ed3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:09:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] Flow 'volume_create_manager' (b8ae5da1-3c36-4055-814d-7f5dc99fa572) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:09:58 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-quobyte-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d" acquired by "_copy_volume_from_snapshot" :: waited 0.059s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:09:58 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] snapshot: 24e22158-f3f1-4425-a892-dd27ad956dc1, volume: ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d, {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 11:09:58 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-8c49423a-7375-4565-be01-52d0d18b4cb1 tempest-AttachVolumeTestJSON-246387978 None] Created volume successfully. Jun 29 11:09:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:09:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:09:58 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:09:58 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:09:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:09:58 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd1565f-860d-4a92-9e92-811a70bfefda]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:09:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a.24e22158-f3f1-4425-a892-dd27ad956dc1 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:58 devstack sudo[99280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a.24e22158-f3f1-4425-a892-dd27ad956dc1 Jun 29 11:09:58 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:09:59 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root Jun 29 11:09:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a.24e22158-f3f1-4425-a892-dd27ad956dc1" returned: 0 in 1.274s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:09:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f58ece7-ad53-4381-8656-73e3d933f10a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:09:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 11:09:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Creating direct copy from snapshot {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 11:09:59 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ede39e-0537-434e-8909-f9e78c5bdf5a]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:09:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:09:59 devstack sudo[99287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a Jun 29 11:09:59 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:00 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a" returned: 0 in 1.428s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:00 devstack cinder-volume[93497]: DEBUG cinder.utils [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Path /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d not found in is_blk_device check {{(pid=93497) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 11:10:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:00 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d Jun 29 11:10:00 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-2029120c-65cf-4ad9-b3d7-d4b6615be6f3 req-8601f101-36d3-40f5-851d-6239dfc1837d tempest-AttachVolumeTestJSON-246387978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:10:07 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:10:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:10:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:10:07 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:10:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:10:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:10:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:08 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:10:08 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:08 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d" returned: 0 in 7.250s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:08 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[97926bd2-3c01-44be-9519-a0bb24c1f6b2]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:10:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:08 devstack sudo[99360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a Jun 29 11:10:08 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:08 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.750s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:08 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:10:08 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager._thread_info {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:10:08 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread count: 28 {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 11:10:08 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread info: [<_MainThread(MainThread, started 131117520400512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 11:10:09 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a" returned: 0 in 1.200s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:09 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Image conversion details: src /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a, size 1024.00 MB, duration 7.25 sec, destination /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d {{(pid=93497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 11:10:09 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Converted 1024.00 MB image at 141.18 MB/s Jun 29 11:10:09 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d is being set with open permissions: ugo+rw Jun 29 11:10:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:09 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d Jun 29 11:10:09 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:10 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d" returned: 0 in 0.664s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:10 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-quobyte-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d" released by "_copy_volume_from_snapshot" :: held 12.013s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:10:10 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-quobyte-24e22158-f3f1-4425-a892-dd27ad956dc1-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d" released by "_create_volume_from_snapshot" :: held 12.094s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:10:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.175s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:10:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-2029120c-65cf-4ad9-b3d7-d4b6615be6f3 req-8601f101-36d3-40f5-851d-6239dfc1837d tempest-AttachVolumeTestJSON-246387978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.521s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:10:10 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72a7321-879d-4b0b-801d-b875bacc06b5]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:10:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-2029120c-65cf-4ad9-b3d7-d4b6615be6f3 req-8601f101-36d3-40f5-851d-6239dfc1837d tempest-AttachVolumeTestJSON-246387978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-adc25e7b-bded-4e76-afee-697e786a20ef {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:10 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d800d44-6121-4eda-af53-39d54ef520fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d', 'volume_size': 1, 'snapshot_id': '24e22158-f3f1-4425-a892-dd27ad956dc1'}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:10:10 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f8d7243-fb74-46ff-ac9c-d11b90744ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:10:10 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Volume volume-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d (ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d): created successfully Jun 29 11:10:10 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f8d7243-fb74-46ff-ac9c-d11b90744ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:10:10 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Flow 'volume_create_manager' (42f7b1f8-15d5-46fe-bf60-9dc7623ba2c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:10:10 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-4ae2cf9c-05aa-4989-b4ba-fb620c8c00c4 tempest-VolumesDeleteCascade-940584758 None] Created volume successfully. Jun 29 11:10:10 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-adc25e7b-bded-4e76-afee-697e786a20ef Jun 29 11:10:10 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:10 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Acquiring lock "cinder-6f58ece7-ad53-4381-8656-73e3d933f10a-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:10:10 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-6f58ece7-ad53-4381-8656-73e3d933f10a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:10:10 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Performing cascade delete. {{(pid=93497) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 29 11:10:10 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Acquiring lock "cinder-24e22158-f3f1-4425-a892-dd27ad956dc1-delete_snapshot" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:10:10 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-24e22158-f3f1-4425-a892-dd27ad956dc1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:10:10 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Acquiring lock "cinder-quobyte-6f58ece7-ad53-4381-8656-73e3d933f10a" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:10:10 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-quobyte-6f58ece7-ad53-4381-8656-73e3d933f10a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:10:10 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Acquiring lock "cinder-quobyte-24e22158-f3f1-4425-a892-dd27ad956dc1" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:10:10 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-quobyte-24e22158-f3f1-4425-a892-dd27ad956dc1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:10:10 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Deleting offline snapshot 24e22158-f3f1-4425-a892-dd27ad956dc1 of volume 6f58ece7-ad53-4381-8656-73e3d933f10a {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:10:10 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] snapshot_file for this snap is: volume-6f58ece7-ad53-4381-8656-73e3d933f10a.24e22158-f3f1-4425-a892-dd27ad956dc1 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:10:10 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[996da644-ce75-4db3-9609-f60057addadb]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:10:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a.24e22158-f3f1-4425-a892-dd27ad956dc1 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:10 devstack sudo[99372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a.24e22158-f3f1-4425-a892-dd27ad956dc1 Jun 29 11:10:10 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:11 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-2029120c-65cf-4ad9-b3d7-d4b6615be6f3 req-8601f101-36d3-40f5-851d-6239dfc1837d tempest-AttachVolumeTestJSON-246387978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-adc25e7b-bded-4e76-afee-697e786a20ef" returned: 0 in 0.929s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-2029120c-65cf-4ad9-b3d7-d4b6615be6f3 req-8601f101-36d3-40f5-851d-6239dfc1837d tempest-AttachVolumeTestJSON-246387978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.951s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:10:11 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-2029120c-65cf-4ad9-b3d7-d4b6615be6f3 req-8601f101-36d3-40f5-851d-6239dfc1837d tempest-AttachVolumeTestJSON-246387978 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3', 'name': 'volume-adc25e7b-bded-4e76-afee-697e786a20ef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a5be628d-a904-4261-840a-c95e206f1f66', 'enforce_multipath': True} {{(pid=93497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 11:10:11 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-2029120c-65cf-4ad9-b3d7-d4b6615be6f3 req-8601f101-36d3-40f5-851d-6239dfc1837d tempest-AttachVolumeTestJSON-246387978 None] attachment_update completed successfully. Jun 29 11:10:11 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a.24e22158-f3f1-4425-a892-dd27ad956dc1" returned: 0 in 0.837s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:11 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f58ece7-ad53-4381-8656-73e3d933f10a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:10:11 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7682dbe-0ebc-4e46-9f75-d10dc6135ff5]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:10:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:11 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a Jun 29 11:10:11 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:12 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a" returned: 0 in 1.115s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a.24e22158-f3f1-4425-a892-dd27ad956dc1 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:12 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a.24e22158-f3f1-4425-a892-dd27ad956dc1 Jun 29 11:10:12 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:12 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:10:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] Flow 'volume_create_manager' (20aa81ab-b7d3-4025-b4e4-890ea7052db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:10:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (954d8d1f-d2f3-4885-9af1-c49ca692d075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:10:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (954d8d1f-d2f3-4885-9af1-c49ca692d075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1185517986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e62258ee-9f12-4415-a239-77e4ae7cd701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d1cc1fd39b6444ebbe963352c9c792a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:10:13Z,use_quota=True,user_id='a85e2793667e4b7cb664fc3063c11d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:10:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4674e7e-cad8-4874-bab2-91e22eb0a1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:10:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4674e7e-cad8-4874-bab2-91e22eb0a1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:10:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73049d41-45d7-489a-9161-9bfd0da138ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:10:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73049d41-45d7-489a-9161-9bfd0da138ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e62258ee-9f12-4415-a239-77e4ae7cd701', 'volume_name': 'volume-e62258ee-9f12-4415-a239-77e4ae7cd701', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:10:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ceaa656-5e5c-4d02-af2d-928045f02290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:10:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ceaa656-5e5c-4d02-af2d-928045f02290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:10:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fc6eafc-0a78-4fbe-928c-3f82a567ac3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:10:12 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] Volume e62258ee-9f12-4415-a239-77e4ae7cd701: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e62258ee-9f12-4415-a239-77e4ae7cd701', 'volume_size': 1} Jun 29 11:10:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:10:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:10:12 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1185517986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e62258ee-9f12-4415-a239-77e4ae7cd701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d1cc1fd39b6444ebbe963352c9c792a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:10:13Z,use_quota=True,user_id='a85e2793667e4b7cb664fc3063c11d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:10:12 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] Creating volume e62258ee-9f12-4415-a239-77e4ae7cd701 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:10:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:10:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:10:12 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:10:12 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:10:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:10:12 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:10:12 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:10:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e62258ee-9f12-4415-a239-77e4ae7cd701 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:12 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e62258ee-9f12-4415-a239-77e4ae7cd701 1073741824 Jun 29 11:10:12 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:13 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a.24e22158-f3f1-4425-a892-dd27ad956dc1" returned: 0 in 0.904s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a.24e22158-f3f1-4425-a892-dd27ad956dc1 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:13 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a.24e22158-f3f1-4425-a892-dd27ad956dc1 Jun 29 11:10:13 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:13 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e62258ee-9f12-4415-a239-77e4ae7cd701 1073741824" returned: 0 in 0.980s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e62258ee-9f12-4415-a239-77e4ae7cd701 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:13 devstack sudo[99803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e62258ee-9f12-4415-a239-77e4ae7cd701 Jun 29 11:10:13 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:14 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a.24e22158-f3f1-4425-a892-dd27ad956dc1" returned: 0 in 0.708s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:14 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-quobyte-24e22158-f3f1-4425-a892-dd27ad956dc1" released by "_delete_snapshot" :: held 3.657s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:10:14 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-quobyte-6f58ece7-ad53-4381-8656-73e3d933f10a" released by "delete_snapshot" :: held 3.680s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:10:14 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Created reservations ['f8500cef-6537-4e35-a45c-7334b204dd6e', '22f9fed5-1b61-4593-bfc8-6051fca43cf5', '03cea0a6-1ab3-4518-b5c0-a65e9bc96362', '37b24713-2d96-4c2b-b829-2b1cb63702fc'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:10:14 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Delete snapshot completed successfully. Jun 29 11:10:14 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-24e22158-f3f1-4425-a892-dd27ad956dc1-delete_snapshot" released by "delete_snapshot" :: held 3.865s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:10:14 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Snapshots deleted, issuing volume delete {{(pid=93497) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 29 11:10:14 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Acquiring lock "cinder-quobyte-6f58ece7-ad53-4381-8656-73e3d933f10a" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:10:14 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-quobyte-6f58ece7-ad53-4381-8656-73e3d933f10a" acquired by "delete_volume" :: waited 0.040s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:10:14 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5aaf65a-0ec9-4093-bd5a-437e5ad0e234]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:10:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:14 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e62258ee-9f12-4415-a239-77e4ae7cd701" returned: 0 in 0.802s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:14 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:10:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:10:14 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fc6eafc-0a78-4fbe-928c-3f82a567ac3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e62258ee-9f12-4415-a239-77e4ae7cd701', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:10:14 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cef9861-785a-4fd7-b636-e2a54f17c926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:10:14 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] Volume volume-e62258ee-9f12-4415-a239-77e4ae7cd701 (e62258ee-9f12-4415-a239-77e4ae7cd701): created successfully Jun 29 11:10:14 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a Jun 29 11:10:14 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:14 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cef9861-785a-4fd7-b636-e2a54f17c926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:10:14 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] Flow 'volume_create_manager' (20aa81ab-b7d3-4025-b4e4-890ea7052db7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:10:14 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-8cf60c24-afff-4f97-a42e-f4f14f3c9fee tempest-ServersNegativeTestJSON-1945396873 None] Created volume successfully. Jun 29 11:10:15 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a" returned: 0 in 0.920s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:15 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a Jun 29 11:10:15 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:16 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6f58ece7-ad53-4381-8656-73e3d933f10a" returned: 0 in 0.760s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:16 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-quobyte-6f58ece7-ad53-4381-8656-73e3d933f10a" released by "delete_volume" :: held 1.778s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:10:16 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Created reservations ['04bed71a-c87c-4965-966d-2b936d13f5cc', '0dab43c1-480d-4a4e-b30e-fd068fb0edf8', '819ec9bd-9cf1-4079-8e68-0d326098779e', '9bc9dc2d-984e-4984-bba3-eaba957840ae'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:10:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:10:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:10:16 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:10:16 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:10:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:10:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:16 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:10:16 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:17 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.814s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:10:17 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Deleted volume successfully. Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ce1d61c6-21e1-4795-a750-e776b4775faa tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-6f58ece7-ad53-4381-8656-73e3d933f10a-delete_volume" released by "delete_volume" :: held 6.783s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-dfd40855-fd06-47ae-b57f-706c9a79b87b tempest-VolumesDeleteCascade-940584758 None] Acquiring lock "cinder-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-dfd40855-fd06-47ae-b57f-706c9a79b87b tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] Flow 'volume_create_manager' (212ca7e0-0329-4caa-bc1d-a005489ca1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c91f11-9c58-456d-8488-ecea1883d17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c91f11-9c58-456d-8488-ecea1883d17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1108229520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=916b9b0d-a4b8-4d8c-a18c-9f588214bbaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d1cc1fd39b6444ebbe963352c9c792a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:10:17Z,use_quota=True,user_id='a85e2793667e4b7cb664fc3063c11d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37046f7f-6ddc-4521-8eeb-bca24703db80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37046f7f-6ddc-4521-8eeb-bca24703db80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (974add45-2ef0-4e9a-a8a3-cc83dafae082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (974add45-2ef0-4e9a-a8a3-cc83dafae082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '916b9b0d-a4b8-4d8c-a18c-9f588214bbaf', 'volume_name': 'volume-916b9b0d-a4b8-4d8c-a18c-9f588214bbaf', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bee5a5f-6cfb-4d7e-937d-0777ac045998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bee5a5f-6cfb-4d7e-937d-0777ac045998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab4d82a1-91ab-409a-93e4-ae175e42bfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:10:17 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] Volume 916b9b0d-a4b8-4d8c-a18c-9f588214bbaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-916b9b0d-a4b8-4d8c-a18c-9f588214bbaf', 'volume_size': 1} Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1108229520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=916b9b0d-a4b8-4d8c-a18c-9f588214bbaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d1cc1fd39b6444ebbe963352c9c792a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:10:17Z,use_quota=True,user_id='a85e2793667e4b7cb664fc3063c11d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] Creating volume 916b9b0d-a4b8-4d8c-a18c-9f588214bbaf {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:10:17 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-916b9b0d-a4b8-4d8c-a18c-9f588214bbaf 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:17 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-916b9b0d-a4b8-4d8c-a18c-9f588214bbaf 1073741824 Jun 29 11:10:17 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-dfd40855-fd06-47ae-b57f-706c9a79b87b tempest-VolumesDeleteCascade-940584758 None] Acquiring lock "cinder-quobyte-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-dfd40855-fd06-47ae-b57f-706c9a79b87b tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-quobyte-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d" acquired by "delete_volume" :: waited 0.016s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[31849b1e-0289-4aec-ac1b-0677a9bd062b]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:10:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dfd40855-fd06-47ae-b57f-706c9a79b87b tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:17 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d Jun 29 11:10:17 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:18 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-916b9b0d-a4b8-4d8c-a18c-9f588214bbaf 1073741824" returned: 0 in 1.039s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:18 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=57,cinder:UPDATE=51,cinder:INSERT=8,cinder:DELETE=4 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:10:18 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:DELETE=5,cinder:SELECT=44,cinder:UPDATE=49,cinder:INSERT=17 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:10:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-916b9b0d-a4b8-4d8c-a18c-9f588214bbaf {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:18 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dfd40855-fd06-47ae-b57f-706c9a79b87b tempest-VolumesDeleteCascade-940584758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d" returned: 0 in 1.059s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dfd40855-fd06-47ae-b57f-706c9a79b87b tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:18 devstack sudo[99862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-916b9b0d-a4b8-4d8c-a18c-9f588214bbaf Jun 29 11:10:18 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:18 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d Jun 29 11:10:18 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:19 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-916b9b0d-a4b8-4d8c-a18c-9f588214bbaf" returned: 0 in 0.845s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:19 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] <== create_volume: return (1967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:10:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.969s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:10:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab4d82a1-91ab-409a-93e4-ae175e42bfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-916b9b0d-a4b8-4d8c-a18c-9f588214bbaf', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:10:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e88f3c7-e679-46f3-9314-28128a4c9881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:10:19 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] Volume volume-916b9b0d-a4b8-4d8c-a18c-9f588214bbaf (916b9b0d-a4b8-4d8c-a18c-9f588214bbaf): created successfully Jun 29 11:10:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e88f3c7-e679-46f3-9314-28128a4c9881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:10:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] Flow 'volume_create_manager' (212ca7e0-0329-4caa-bc1d-a005489ca1ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:10:19 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dfd40855-fd06-47ae-b57f-706c9a79b87b tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d" returned: 0 in 0.889s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:19 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-cf581f8c-b473-4496-a1d1-3d295dc691b6 tempest-ServersNegativeTestJSON-1945396873 None] Created volume successfully. Jun 29 11:10:19 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-dfd40855-fd06-47ae-b57f-706c9a79b87b tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-quobyte-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d" released by "delete_volume" :: held 1.996s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:10:19 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-dfd40855-fd06-47ae-b57f-706c9a79b87b tempest-VolumesDeleteCascade-940584758 None] Created reservations ['d662d7d8-8ae5-48a4-bd6a-031fb95ebd6e', '49cf6a46-089e-46eb-b88f-5817bd8c41d3', '78a504d5-50b6-4dc4-912a-0bdcb5f6043e', '095d146e-0302-4050-a8bb-fe6bf90b4149'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:10:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-dfd40855-fd06-47ae-b57f-706c9a79b87b tempest-VolumesDeleteCascade-940584758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:10:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-dfd40855-fd06-47ae-b57f-706c9a79b87b tempest-VolumesDeleteCascade-940584758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:10:19 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-dfd40855-fd06-47ae-b57f-706c9a79b87b tempest-VolumesDeleteCascade-940584758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:10:19 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-dfd40855-fd06-47ae-b57f-706c9a79b87b tempest-VolumesDeleteCascade-940584758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:10:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-dfd40855-fd06-47ae-b57f-706c9a79b87b tempest-VolumesDeleteCascade-940584758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:10:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dfd40855-fd06-47ae-b57f-706c9a79b87b tempest-VolumesDeleteCascade-940584758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:19 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:10:19 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:20 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dfd40855-fd06-47ae-b57f-706c9a79b87b tempest-VolumesDeleteCascade-940584758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.692s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:20 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-dfd40855-fd06-47ae-b57f-706c9a79b87b tempest-VolumesDeleteCascade-940584758 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:10:20 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-dfd40855-fd06-47ae-b57f-706c9a79b87b tempest-VolumesDeleteCascade-940584758 None] Deleted volume successfully. Jun 29 11:10:20 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-dfd40855-fd06-47ae-b57f-706c9a79b87b tempest-VolumesDeleteCascade-940584758 None] Lock "cinder-ef9df7a5-ee1d-4bc7-a3d2-46cc41c9073d-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:10:20 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-bac9b482-f29c-4079-a661-237d83966fa4 tempest-ServersNegativeTestJSON-1945396873 None] Acquiring lock "cinder-916b9b0d-a4b8-4d8c-a18c-9f588214bbaf-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:10:20 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-bac9b482-f29c-4079-a661-237d83966fa4 tempest-ServersNegativeTestJSON-1945396873 None] Lock "cinder-916b9b0d-a4b8-4d8c-a18c-9f588214bbaf-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:10:20 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-bac9b482-f29c-4079-a661-237d83966fa4 tempest-ServersNegativeTestJSON-1945396873 None] Acquiring lock "cinder-quobyte-916b9b0d-a4b8-4d8c-a18c-9f588214bbaf" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:10:20 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-bac9b482-f29c-4079-a661-237d83966fa4 tempest-ServersNegativeTestJSON-1945396873 None] Lock "cinder-quobyte-916b9b0d-a4b8-4d8c-a18c-9f588214bbaf" acquired by "delete_volume" :: waited 0.017s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:10:20 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7ea5fb-29dc-4542-82fa-ed38e30046d7]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:10:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-bac9b482-f29c-4079-a661-237d83966fa4 tempest-ServersNegativeTestJSON-1945396873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-916b9b0d-a4b8-4d8c-a18c-9f588214bbaf {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:21 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-916b9b0d-a4b8-4d8c-a18c-9f588214bbaf Jun 29 11:10:21 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:21 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-bac9b482-f29c-4079-a661-237d83966fa4 tempest-ServersNegativeTestJSON-1945396873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-916b9b0d-a4b8-4d8c-a18c-9f588214bbaf" returned: 0 in 0.863s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-bac9b482-f29c-4079-a661-237d83966fa4 tempest-ServersNegativeTestJSON-1945396873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-916b9b0d-a4b8-4d8c-a18c-9f588214bbaf {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:21 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-916b9b0d-a4b8-4d8c-a18c-9f588214bbaf Jun 29 11:10:21 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:22 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-bac9b482-f29c-4079-a661-237d83966fa4 tempest-ServersNegativeTestJSON-1945396873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-916b9b0d-a4b8-4d8c-a18c-9f588214bbaf" returned: 0 in 0.902s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:22 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-bac9b482-f29c-4079-a661-237d83966fa4 tempest-ServersNegativeTestJSON-1945396873 None] Lock "cinder-quobyte-916b9b0d-a4b8-4d8c-a18c-9f588214bbaf" released by "delete_volume" :: held 1.816s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:10:22 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-bac9b482-f29c-4079-a661-237d83966fa4 tempest-ServersNegativeTestJSON-1945396873 None] Created reservations ['3ce46428-3eb3-4e15-977b-2d3e76eca72f', '91acd0a9-a792-47fd-83c9-dc4d06e9aeb5', '7a7f51ba-f198-4fbd-abde-9f0803483d31', '6ae5613d-d46f-41c1-a0b8-a2217d21a8e7'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:10:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-bac9b482-f29c-4079-a661-237d83966fa4 tempest-ServersNegativeTestJSON-1945396873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:10:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-bac9b482-f29c-4079-a661-237d83966fa4 tempest-ServersNegativeTestJSON-1945396873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:10:22 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-bac9b482-f29c-4079-a661-237d83966fa4 tempest-ServersNegativeTestJSON-1945396873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:10:22 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-bac9b482-f29c-4079-a661-237d83966fa4 tempest-ServersNegativeTestJSON-1945396873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:10:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-bac9b482-f29c-4079-a661-237d83966fa4 tempest-ServersNegativeTestJSON-1945396873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:10:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-bac9b482-f29c-4079-a661-237d83966fa4 tempest-ServersNegativeTestJSON-1945396873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:22 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:10:22 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:23 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-966f0500-54a7-48f0-a7f3-33e83d8ee47d tempest-ServersNegativeTestJSON-1945396873 None] Acquiring lock "cinder-e62258ee-9f12-4415-a239-77e4ae7cd701-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:10:23 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-966f0500-54a7-48f0-a7f3-33e83d8ee47d tempest-ServersNegativeTestJSON-1945396873 None] Lock "cinder-e62258ee-9f12-4415-a239-77e4ae7cd701-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:10:23 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-966f0500-54a7-48f0-a7f3-33e83d8ee47d tempest-ServersNegativeTestJSON-1945396873 None] Acquiring lock "cinder-quobyte-e62258ee-9f12-4415-a239-77e4ae7cd701" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:10:23 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-966f0500-54a7-48f0-a7f3-33e83d8ee47d tempest-ServersNegativeTestJSON-1945396873 None] Lock "cinder-quobyte-e62258ee-9f12-4415-a239-77e4ae7cd701" acquired by "delete_volume" :: waited 0.015s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:10:23 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab859217-7568-408b-8bd8-2ad5af66cf6a]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:10:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-966f0500-54a7-48f0-a7f3-33e83d8ee47d tempest-ServersNegativeTestJSON-1945396873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e62258ee-9f12-4415-a239-77e4ae7cd701 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:23 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e62258ee-9f12-4415-a239-77e4ae7cd701 Jun 29 11:10:23 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:23 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-bac9b482-f29c-4079-a661-237d83966fa4 tempest-ServersNegativeTestJSON-1945396873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.839s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:23 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-bac9b482-f29c-4079-a661-237d83966fa4 tempest-ServersNegativeTestJSON-1945396873 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:10:23 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-bac9b482-f29c-4079-a661-237d83966fa4 tempest-ServersNegativeTestJSON-1945396873 None] Deleted volume successfully. Jun 29 11:10:23 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-bac9b482-f29c-4079-a661-237d83966fa4 tempest-ServersNegativeTestJSON-1945396873 None] Lock "cinder-916b9b0d-a4b8-4d8c-a18c-9f588214bbaf-delete_volume" released by "delete_volume" :: held 2.911s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:10:24 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-966f0500-54a7-48f0-a7f3-33e83d8ee47d tempest-ServersNegativeTestJSON-1945396873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e62258ee-9f12-4415-a239-77e4ae7cd701" returned: 0 in 0.949s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-966f0500-54a7-48f0-a7f3-33e83d8ee47d tempest-ServersNegativeTestJSON-1945396873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e62258ee-9f12-4415-a239-77e4ae7cd701 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:24 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e62258ee-9f12-4415-a239-77e4ae7cd701 Jun 29 11:10:24 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:25 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-966f0500-54a7-48f0-a7f3-33e83d8ee47d tempest-ServersNegativeTestJSON-1945396873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e62258ee-9f12-4415-a239-77e4ae7cd701" returned: 0 in 0.786s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:25 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-966f0500-54a7-48f0-a7f3-33e83d8ee47d tempest-ServersNegativeTestJSON-1945396873 None] Lock "cinder-quobyte-e62258ee-9f12-4415-a239-77e4ae7cd701" released by "delete_volume" :: held 1.792s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:10:25 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-966f0500-54a7-48f0-a7f3-33e83d8ee47d tempest-ServersNegativeTestJSON-1945396873 None] Created reservations ['f19a50c5-dbc9-4fdb-8e0c-5da27e0f2e97', '4e666f54-7fc8-4593-b9ed-2a80e23e7c6b', '06d1ef7e-92d7-48c3-b8cc-8a2190b0a0f8', '1a18f841-d384-4f07-8540-66af56a332f9'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:10:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-966f0500-54a7-48f0-a7f3-33e83d8ee47d tempest-ServersNegativeTestJSON-1945396873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:10:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-966f0500-54a7-48f0-a7f3-33e83d8ee47d tempest-ServersNegativeTestJSON-1945396873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:10:25 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-966f0500-54a7-48f0-a7f3-33e83d8ee47d tempest-ServersNegativeTestJSON-1945396873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:10:25 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-966f0500-54a7-48f0-a7f3-33e83d8ee47d tempest-ServersNegativeTestJSON-1945396873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:10:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-966f0500-54a7-48f0-a7f3-33e83d8ee47d tempest-ServersNegativeTestJSON-1945396873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:10:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-966f0500-54a7-48f0-a7f3-33e83d8ee47d tempest-ServersNegativeTestJSON-1945396873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:25 devstack sudo[99933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:10:25 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:26 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-966f0500-54a7-48f0-a7f3-33e83d8ee47d tempest-ServersNegativeTestJSON-1945396873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.912s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:26 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-966f0500-54a7-48f0-a7f3-33e83d8ee47d tempest-ServersNegativeTestJSON-1945396873 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:10:26 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-966f0500-54a7-48f0-a7f3-33e83d8ee47d tempest-ServersNegativeTestJSON-1945396873 None] Deleted volume successfully. Jun 29 11:10:26 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-966f0500-54a7-48f0-a7f3-33e83d8ee47d tempest-ServersNegativeTestJSON-1945396873 None] Lock "cinder-e62258ee-9f12-4415-a239-77e4ae7cd701-delete_volume" released by "delete_volume" :: held 3.003s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:10:35 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=16,cinder:INSERT=10,cinder:UPDATE=29,cinder:DELETE=1 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:10:36 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:UPDATE=22,cinder:SELECT=13,cinder:DELETE=3,cinder:INSERT=3 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:10:37 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4093cf81-3c2b-46d8-825b-03c8666dd473 tempest-AttachVolumeShelveTestJSON-253942392 None] Acquiring lock "cinder-4c7098c0-87ec-451e-bee8-895c447844d4-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:10:37 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4093cf81-3c2b-46d8-825b-03c8666dd473 tempest-AttachVolumeShelveTestJSON-253942392 None] Lock "cinder-4c7098c0-87ec-451e-bee8-895c447844d4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:10:37 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4093cf81-3c2b-46d8-825b-03c8666dd473 tempest-AttachVolumeShelveTestJSON-253942392 None] Acquiring lock "cinder-quobyte-4c7098c0-87ec-451e-bee8-895c447844d4" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:10:37 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4093cf81-3c2b-46d8-825b-03c8666dd473 tempest-AttachVolumeShelveTestJSON-253942392 None] Lock "cinder-quobyte-4c7098c0-87ec-451e-bee8-895c447844d4" acquired by "delete_volume" :: waited 0.021s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:10:37 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbdf7d9-b3fb-4bc5-bfa5-a071fb23126c]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:10:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4093cf81-3c2b-46d8-825b-03c8666dd473 tempest-AttachVolumeShelveTestJSON-253942392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4c7098c0-87ec-451e-bee8-895c447844d4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:37 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4c7098c0-87ec-451e-bee8-895c447844d4 Jun 29 11:10:37 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:38 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4093cf81-3c2b-46d8-825b-03c8666dd473 tempest-AttachVolumeShelveTestJSON-253942392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4c7098c0-87ec-451e-bee8-895c447844d4" returned: 0 in 1.136s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4093cf81-3c2b-46d8-825b-03c8666dd473 tempest-AttachVolumeShelveTestJSON-253942392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4c7098c0-87ec-451e-bee8-895c447844d4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:38 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4c7098c0-87ec-451e-bee8-895c447844d4 Jun 29 11:10:38 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:39 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4093cf81-3c2b-46d8-825b-03c8666dd473 tempest-AttachVolumeShelveTestJSON-253942392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4c7098c0-87ec-451e-bee8-895c447844d4" returned: 0 in 1.057s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:39 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4093cf81-3c2b-46d8-825b-03c8666dd473 tempest-AttachVolumeShelveTestJSON-253942392 None] Lock "cinder-quobyte-4c7098c0-87ec-451e-bee8-895c447844d4" released by "delete_volume" :: held 2.268s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:10:39 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-4093cf81-3c2b-46d8-825b-03c8666dd473 tempest-AttachVolumeShelveTestJSON-253942392 None] Created reservations ['9d7fd1cd-142f-4a8c-8805-0b2d74925515', '255f3b56-e891-4393-a399-06be711d801b', 'beeb4402-3ded-419a-9a11-380dfcfcbd13', '84ac24cf-29fe-4cb3-b5f4-dcff2ec35f38'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:10:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4093cf81-3c2b-46d8-825b-03c8666dd473 tempest-AttachVolumeShelveTestJSON-253942392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:10:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4093cf81-3c2b-46d8-825b-03c8666dd473 tempest-AttachVolumeShelveTestJSON-253942392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:10:39 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4093cf81-3c2b-46d8-825b-03c8666dd473 tempest-AttachVolumeShelveTestJSON-253942392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:10:39 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4093cf81-3c2b-46d8-825b-03c8666dd473 tempest-AttachVolumeShelveTestJSON-253942392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:10:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4093cf81-3c2b-46d8-825b-03c8666dd473 tempest-AttachVolumeShelveTestJSON-253942392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:10:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4093cf81-3c2b-46d8-825b-03c8666dd473 tempest-AttachVolumeShelveTestJSON-253942392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:39 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:10:39 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:40 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:10:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] Flow 'volume_create_manager' (b76e4ee7-2084-4289-be28-e9f13bdf6bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:10:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477f0d0a-e4e0-43a6-8df4-a142919e2553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:10:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477f0d0a-e4e0-43a6-8df4-a142919e2553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1976176243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e415c41e-6257-4ff9-8e36-2b61750b7e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599d0bb908fb4912a34d96eee28d67b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:10:40Z,use_quota=True,user_id='58508998626c4ba783ed4992368aa724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:10:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (420f705a-0a14-4b79-9576-219b92cb6a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:10:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (420f705a-0a14-4b79-9576-219b92cb6a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:10:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c5c96c3-b2f8-4a7b-8160-088673ff67b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:10:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c5c96c3-b2f8-4a7b-8160-088673ff67b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e415c41e-6257-4ff9-8e36-2b61750b7e86', 'volume_name': 'volume-e415c41e-6257-4ff9-8e36-2b61750b7e86', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:10:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b1228a6-02ac-447f-9fd7-1e518ff70bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:10:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b1228a6-02ac-447f-9fd7-1e518ff70bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:10:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55010b95-91ac-47bf-8118-bff41b707a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:10:40 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] Volume e415c41e-6257-4ff9-8e36-2b61750b7e86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e415c41e-6257-4ff9-8e36-2b61750b7e86', 'volume_size': 1} Jun 29 11:10:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:10:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:10:40 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1976176243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e415c41e-6257-4ff9-8e36-2b61750b7e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599d0bb908fb4912a34d96eee28d67b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:10:40Z,use_quota=True,user_id='58508998626c4ba783ed4992368aa724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:10:40 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] Creating volume e415c41e-6257-4ff9-8e36-2b61750b7e86 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:10:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:10:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:10:40 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:10:40 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:10:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:10:40 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:10:40 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:10:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:40 devstack sudo[100558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86 1073741824 Jun 29 11:10:40 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:40 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4093cf81-3c2b-46d8-825b-03c8666dd473 tempest-AttachVolumeShelveTestJSON-253942392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.074s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:40 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-4093cf81-3c2b-46d8-825b-03c8666dd473 tempest-AttachVolumeShelveTestJSON-253942392 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:10:40 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-4093cf81-3c2b-46d8-825b-03c8666dd473 tempest-AttachVolumeShelveTestJSON-253942392 None] Deleted volume successfully. Jun 29 11:10:40 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4093cf81-3c2b-46d8-825b-03c8666dd473 tempest-AttachVolumeShelveTestJSON-253942392 None] Lock "cinder-4c7098c0-87ec-451e-bee8-895c447844d4-delete_volume" released by "delete_volume" :: held 3.777s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:10:41 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86 1073741824" returned: 0 in 1.357s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:41 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86 Jun 29 11:10:41 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:42 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86" returned: 0 in 1.161s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:42 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] <== create_volume: return (2581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:10:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.584s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:10:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55010b95-91ac-47bf-8118-bff41b707a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e415c41e-6257-4ff9-8e36-2b61750b7e86', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:10:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c350ba2-c104-49a3-a616-09cb13c9d163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:10:43 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] Volume volume-e415c41e-6257-4ff9-8e36-2b61750b7e86 (e415c41e-6257-4ff9-8e36-2b61750b7e86): created successfully Jun 29 11:10:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c350ba2-c104-49a3-a616-09cb13c9d163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:10:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] Flow 'volume_create_manager' (b76e4ee7-2084-4289-be28-e9f13bdf6bc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:10:43 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-75c17c68-cc93-48ee-94d2-179f5cc21361 tempest-VolumesActionsTest-144281045 None] Created volume successfully. Jun 29 11:10:53 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:UPDATE=14,cinder:SELECT=6,cinder:INSERT=3 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:10:53 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=2 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:10:54 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-119525fe-328c-4b01-8c2f-60c20d52e5e0 tempest-GroupSnapshotsV319Test-1737935141 None] Group tempest-GroupSnapshotsV319Test-Group-2076281504: creating Jun 29 11:10:54 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-119525fe-328c-4b01-8c2f-60c20d52e5e0 tempest-GroupSnapshotsV319Test-1737935141 None] Group tempest-GroupSnapshotsV319Test-Group-2076281504: created successfully Jun 29 11:10:54 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-119525fe-328c-4b01-8c2f-60c20d52e5e0 tempest-GroupSnapshotsV319Test-1737935141 None] Create group completed successfully. Jun 29 11:10:56 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:10:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] Flow 'volume_create_manager' (34f781b6-fc25-4265-9bdb-ee3395d95263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:10:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e7f034c-2979-4fce-ac56-38f4a727a510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:10:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e7f034c-2979-4fce-ac56-38f4a727a510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1140735266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a3bed0b9-8ea0-4bb3-a135-3713f08d93a4,host='devstack@QuobyteHD#QuobyteHD',id=ed822b07-1c1c-4d27-b28c-cfc785fdba70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35b13235decf4540bbcf4fd6a26385a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:10:56Z,use_quota=True,user_id='eea7b480cc6c47419ad5a9f0be601f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5d702c-18fc-4107-a4af-f55f6700182f),volume_type_id=ab5d702c-18fc-4107-a4af-f55f6700182f)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:10:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac144bc-4966-4e4a-ae7f-6912af6f575d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:10:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac144bc-4966-4e4a-ae7f-6912af6f575d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:10:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4da5699e-4415-44c8-89ac-230ab2cd20ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:10:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4da5699e-4415-44c8-89ac-230ab2cd20ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed822b07-1c1c-4d27-b28c-cfc785fdba70', 'volume_name': 'volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:10:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a855f54-3c78-46e0-9c58-ab1cd9495c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:10:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a855f54-3c78-46e0-9c58-ab1cd9495c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:10:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c667dae-c026-420d-9f9d-28b5fc2315db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:10:56 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] Volume ed822b07-1c1c-4d27-b28c-cfc785fdba70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70', 'volume_size': 1} Jun 29 11:10:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:10:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:10:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a3bed0b9-8ea0-4bb3-a135-3713f08d93a4,created_at=2026-06-29T09:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1140735266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a3bed0b9-8ea0-4bb3-a135-3713f08d93a4,host='devstack@QuobyteHD#QuobyteHD',id=ed822b07-1c1c-4d27-b28c-cfc785fdba70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35b13235decf4540bbcf4fd6a26385a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:10:56Z,use_quota=True,user_id='eea7b480cc6c47419ad5a9f0be601f97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab5d702c-18fc-4107-a4af-f55f6700182f),volume_type_id=ab5d702c-18fc-4107-a4af-f55f6700182f)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:10:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] Creating volume ed822b07-1c1c-4d27-b28c-cfc785fdba70 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:10:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:10:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:10:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:10:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:10:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:10:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:10:56 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:10:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:56 devstack sudo[100655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70 1073741824 Jun 29 11:10:56 devstack sudo[100655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:57 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-8762dd3d-8aa3-41b4-a1e0-9226f2f38ee4 req-e2a0372c-f686-40c6-a490-e802ed1a934e tempest-AttachVolumeTestJSON-246387978 None] Terminate volume connection completed successfully. Jun 29 11:10:57 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-8762dd3d-8aa3-41b4-a1e0-9226f2f38ee4 req-e2a0372c-f686-40c6-a490-e802ed1a934e tempest-AttachVolumeTestJSON-246387978 None] Deleting attachment a5be628d-a904-4261-840a-c95e206f1f66. {{(pid=93497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 11:10:57 devstack sudo[100655]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70 1073741824" returned: 0 in 1.447s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:10:57 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70 Jun 29 11:10:57 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:10:58 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Jun 29 11:10:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70" returned: 0 in 0.885s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:10:58 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] <== create_volume: return (2384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:10:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.389s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:10:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c667dae-c026-420d-9f9d-28b5fc2315db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:10:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc86d6d-a780-41e8-bfe4-02e907de7432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:10:58 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] Volume volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70 (ed822b07-1c1c-4d27-b28c-cfc785fdba70): created successfully Jun 29 11:10:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc86d6d-a780-41e8-bfe4-02e907de7432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:10:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] Flow 'volume_create_manager' (34f781b6-fc25-4265-9bdb-ee3395d95263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:10:58 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-3b12ad39-5c26-42d9-b48a-218e2b6157f1 tempest-GroupSnapshotsV319Test-1737935141 None] Created volume successfully. Jun 29 11:11:00 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-d2c970d0-6dca-40b5-88e6-5dcb508ff5d4 tempest-GroupSnapshotsV319Test-1737935141 None] GroupSnapshot e58c41e6-89ef-463e-9b58-dbf2e57a65fb: creating. Jun 29 11:11:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d2c970d0-6dca-40b5-88e6-5dcb508ff5d4 tempest-GroupSnapshotsV319Test-1737935141 None] Group snapshot e58c41e6-89ef-463e-9b58-dbf2e57a65fb: creating. {{(pid=93497) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 29 11:11:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d2c970d0-6dca-40b5-88e6-5dcb508ff5d4 tempest-GroupSnapshotsV319Test-1737935141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:11:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d2c970d0-6dca-40b5-88e6-5dcb508ff5d4 tempest-GroupSnapshotsV319Test-1737935141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:11:00 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-d2c970d0-6dca-40b5-88e6-5dcb508ff5d4 tempest-GroupSnapshotsV319Test-1737935141 None] Creating offline snapshot f20235e2-8745-4343-8c49-7e2895601222 of volume ed822b07-1c1c-4d27-b28c-cfc785fdba70 {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:11:00 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[317e87a9-d0a5-4494-9ea4-bc078ed396fe]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:11:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d2c970d0-6dca-40b5-88e6-5dcb508ff5d4 tempest-GroupSnapshotsV319Test-1737935141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:00 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70 Jun 29 11:11:00 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:01 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d2c970d0-6dca-40b5-88e6-5dcb508ff5d4 tempest-GroupSnapshotsV319Test-1737935141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70" returned: 0 in 1.161s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d2c970d0-6dca-40b5-88e6-5dcb508ff5d4 tempest-GroupSnapshotsV319Test-1737935141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70.f20235e2-8745-4343-8c49-7e2895601222 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:01 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70.f20235e2-8745-4343-8c49-7e2895601222 1G Jun 29 11:11:01 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:02 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d2c970d0-6dca-40b5-88e6-5dcb508ff5d4 tempest-GroupSnapshotsV319Test-1737935141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70.f20235e2-8745-4343-8c49-7e2895601222 1G" returned: 0 in 1.080s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d2c970d0-6dca-40b5-88e6-5dcb508ff5d4 tempest-GroupSnapshotsV319Test-1737935141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70.f20235e2-8745-4343-8c49-7e2895601222 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:02 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70.f20235e2-8745-4343-8c49-7e2895601222 Jun 29 11:11:02 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:03 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d2c970d0-6dca-40b5-88e6-5dcb508ff5d4 tempest-GroupSnapshotsV319Test-1737935141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70.f20235e2-8745-4343-8c49-7e2895601222" returned: 0 in 0.863s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:03 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-d2c970d0-6dca-40b5-88e6-5dcb508ff5d4 tempest-GroupSnapshotsV319Test-1737935141 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70.f20235e2-8745-4343-8c49-7e2895601222 is being set with open permissions: ugo+rw: NotImplementedError Jun 29 11:11:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d2c970d0-6dca-40b5-88e6-5dcb508ff5d4 tempest-GroupSnapshotsV319Test-1737935141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70.f20235e2-8745-4343-8c49-7e2895601222 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:03 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70.f20235e2-8745-4343-8c49-7e2895601222 Jun 29 11:11:03 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:04 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d2c970d0-6dca-40b5-88e6-5dcb508ff5d4 tempest-GroupSnapshotsV319Test-1737935141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70.f20235e2-8745-4343-8c49-7e2895601222" returned: 0 in 0.805s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d2c970d0-6dca-40b5-88e6-5dcb508ff5d4 tempest-GroupSnapshotsV319Test-1737935141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:04 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70.info Jun 29 11:11:04 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:05 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d2c970d0-6dca-40b5-88e6-5dcb508ff5d4 tempest-GroupSnapshotsV319Test-1737935141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70.info" returned: 0 in 0.926s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:05 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-d2c970d0-6dca-40b5-88e6-5dcb508ff5d4 tempest-GroupSnapshotsV319Test-1737935141 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70.info is being set with open permissions: ugo+rw: NotImplementedError Jun 29 11:11:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d2c970d0-6dca-40b5-88e6-5dcb508ff5d4 tempest-GroupSnapshotsV319Test-1737935141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:05 devstack sudo[100772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70.info Jun 29 11:11:05 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:06 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d2c970d0-6dca-40b5-88e6-5dcb508ff5d4 tempest-GroupSnapshotsV319Test-1737935141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70.info" returned: 0 in 1.148s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d2c970d0-6dca-40b5-88e6-5dcb508ff5d4 tempest-GroupSnapshotsV319Test-1737935141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.129s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:11:06 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-d2c970d0-6dca-40b5-88e6-5dcb508ff5d4 tempest-GroupSnapshotsV319Test-1737935141 None] group_snapshot e58c41e6-89ef-463e-9b58-dbf2e57a65fb: created successfully Jun 29 11:11:07 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-8e1ef49e-5360-4121-80e2-8a54bedc6ed9 tempest-GroupSnapshotsV319Test-1737935141 None] group_snapshot e58c41e6-89ef-463e-9b58-dbf2e57a65fb: deleting Jun 29 11:11:07 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8e1ef49e-5360-4121-80e2-8a54bedc6ed9 tempest-GroupSnapshotsV319Test-1737935141 None] group_snapshot e58c41e6-89ef-463e-9b58-dbf2e57a65fb: deleting {{(pid=93497) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 29 11:11:07 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8e1ef49e-5360-4121-80e2-8a54bedc6ed9 tempest-GroupSnapshotsV319Test-1737935141 None] Acquiring lock "cinder-quobyte-ed822b07-1c1c-4d27-b28c-cfc785fdba70" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:11:07 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8e1ef49e-5360-4121-80e2-8a54bedc6ed9 tempest-GroupSnapshotsV319Test-1737935141 None] Lock "cinder-quobyte-ed822b07-1c1c-4d27-b28c-cfc785fdba70" acquired by "delete_snapshot" :: waited 0.085s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:11:07 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8e1ef49e-5360-4121-80e2-8a54bedc6ed9 tempest-GroupSnapshotsV319Test-1737935141 None] Acquiring lock "cinder-quobyte-f20235e2-8745-4343-8c49-7e2895601222" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:11:07 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8e1ef49e-5360-4121-80e2-8a54bedc6ed9 tempest-GroupSnapshotsV319Test-1737935141 None] Lock "cinder-quobyte-f20235e2-8745-4343-8c49-7e2895601222" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:11:07 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-8e1ef49e-5360-4121-80e2-8a54bedc6ed9 tempest-GroupSnapshotsV319Test-1737935141 None] Deleting offline snapshot f20235e2-8745-4343-8c49-7e2895601222 of volume ed822b07-1c1c-4d27-b28c-cfc785fdba70 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:11:07 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-8e1ef49e-5360-4121-80e2-8a54bedc6ed9 tempest-GroupSnapshotsV319Test-1737935141 None] snapshot_file for this snap is: volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70.f20235e2-8745-4343-8c49-7e2895601222 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:11:08 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:11:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:11:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:11:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:11:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:11:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:11:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:08 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6b3385-df6f-4cc9-baa2-73d16577f447]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:11:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8e1ef49e-5360-4121-80e2-8a54bedc6ed9 tempest-GroupSnapshotsV319Test-1737935141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70.f20235e2-8745-4343-8c49-7e2895601222 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:08 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:11:08 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:08 devstack sudo[100884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70.f20235e2-8745-4343-8c49-7e2895601222 Jun 29 11:11:08 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:09 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.773s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:09 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:11:09 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager._thread_info {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:11:09 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread count: 28 {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 11:11:09 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread info: [<_MainThread(MainThread, started 131117520400512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 11:11:10 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8e1ef49e-5360-4121-80e2-8a54bedc6ed9 tempest-GroupSnapshotsV319Test-1737935141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70.f20235e2-8745-4343-8c49-7e2895601222" returned: 0 in 2.059s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:10 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-8e1ef49e-5360-4121-80e2-8a54bedc6ed9 tempest-GroupSnapshotsV319Test-1737935141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:11:10 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1bd126-fc85-49d6-acec-3f771e818be8]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:11:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8e1ef49e-5360-4121-80e2-8a54bedc6ed9 tempest-GroupSnapshotsV319Test-1737935141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:10 devstack sudo[100895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70 Jun 29 11:11:10 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:11 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1bedf0b9-4afa-4e57-9694-5711999de5dc tempest-VolumesActionsTest-144281045 None] Acquiring lock "cinder-e415c41e-6257-4ff9-8e36-2b61750b7e86" by "attach_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:11:11 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1bedf0b9-4afa-4e57-9694-5711999de5dc tempest-VolumesActionsTest-144281045 None] Lock "cinder-e415c41e-6257-4ff9-8e36-2b61750b7e86" acquired by "attach_volume" :: waited 0.025s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:11:11 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-1bedf0b9-4afa-4e57-9694-5711999de5dc tempest-VolumesActionsTest-144281045 None] Attaching volume e415c41e-6257-4ff9-8e36-2b61750b7e86 to instance 8dc1695c-37eb-4061-bb43-c5a3c8b588fa at mountpoint /dev/vdb on host None. Jun 29 11:11:11 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-1bedf0b9-4afa-4e57-9694-5711999de5dc tempest-VolumesActionsTest-144281045 None] Attach volume completed successfully. Jun 29 11:11:11 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1bedf0b9-4afa-4e57-9694-5711999de5dc tempest-VolumesActionsTest-144281045 None] Lock "cinder-e415c41e-6257-4ff9-8e36-2b61750b7e86" released by "attach_volume" :: held 0.161s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:11:11 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8e1ef49e-5360-4121-80e2-8a54bedc6ed9 tempest-GroupSnapshotsV319Test-1737935141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70" returned: 0 in 1.582s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8e1ef49e-5360-4121-80e2-8a54bedc6ed9 tempest-GroupSnapshotsV319Test-1737935141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70.f20235e2-8745-4343-8c49-7e2895601222 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:11 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70.f20235e2-8745-4343-8c49-7e2895601222 Jun 29 11:11:11 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:12 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-58f352af-bbc1-4733-9a2e-1d779f8dcd7e tempest-VolumesActionsTest-144281045 None] Acquiring lock "cinder-e415c41e-6257-4ff9-8e36-2b61750b7e86-detach_volume" by "detach_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:11:12 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-58f352af-bbc1-4733-9a2e-1d779f8dcd7e tempest-VolumesActionsTest-144281045 None] Lock "cinder-e415c41e-6257-4ff9-8e36-2b61750b7e86-detach_volume" acquired by "detach_volume" :: waited 0.058s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:11:12 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-58f352af-bbc1-4733-9a2e-1d779f8dcd7e tempest-VolumesActionsTest-144281045 None] Detaching volume e415c41e-6257-4ff9-8e36-2b61750b7e86 from instance 8dc1695c-37eb-4061-bb43-c5a3c8b588fa. Jun 29 11:11:12 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-58f352af-bbc1-4733-9a2e-1d779f8dcd7e tempest-VolumesActionsTest-144281045 None] Detach volume completed successfully. Jun 29 11:11:12 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-58f352af-bbc1-4733-9a2e-1d779f8dcd7e tempest-VolumesActionsTest-144281045 None] Lock "cinder-e415c41e-6257-4ff9-8e36-2b61750b7e86-detach_volume" released by "detach_volume" :: held 0.171s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:11:13 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8e1ef49e-5360-4121-80e2-8a54bedc6ed9 tempest-GroupSnapshotsV319Test-1737935141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70.f20235e2-8745-4343-8c49-7e2895601222" returned: 0 in 1.413s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8e1ef49e-5360-4121-80e2-8a54bedc6ed9 tempest-GroupSnapshotsV319Test-1737935141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70.f20235e2-8745-4343-8c49-7e2895601222 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:13 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70.f20235e2-8745-4343-8c49-7e2895601222 Jun 29 11:11:13 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:15 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8e1ef49e-5360-4121-80e2-8a54bedc6ed9 tempest-GroupSnapshotsV319Test-1737935141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70.f20235e2-8745-4343-8c49-7e2895601222" returned: 0 in 1.917s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:15 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8e1ef49e-5360-4121-80e2-8a54bedc6ed9 tempest-GroupSnapshotsV319Test-1737935141 None] Lock "cinder-quobyte-f20235e2-8745-4343-8c49-7e2895601222" released by "_delete_snapshot" :: held 7.460s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:11:15 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8e1ef49e-5360-4121-80e2-8a54bedc6ed9 tempest-GroupSnapshotsV319Test-1737935141 None] Lock "cinder-quobyte-ed822b07-1c1c-4d27-b28c-cfc785fdba70" released by "delete_snapshot" :: held 7.544s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:11:15 devstack cinder-volume[93497]: WARNING cinder.quota [None req-8e1ef49e-5360-4121-80e2-8a54bedc6ed9 tempest-GroupSnapshotsV319Test-1737935141 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-463185810 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-463185810, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:11:15 devstack cinder-volume[93497]: WARNING cinder.quota [None req-8e1ef49e-5360-4121-80e2-8a54bedc6ed9 tempest-GroupSnapshotsV319Test-1737935141 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-463185810 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-463185810, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:11:15 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-8e1ef49e-5360-4121-80e2-8a54bedc6ed9 tempest-GroupSnapshotsV319Test-1737935141 None] Created reservations ['3c24d414-8512-4c93-b40a-debf5b963003', 'ba58ff05-d19d-4e6a-a560-ce286f73f7ce', 'cb4f8f4f-30a6-4a86-8c13-81ff73e9cfd0', 'b31aaadb-fc1c-4c6e-b200-c0e6bc081171'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:11:15 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-8e1ef49e-5360-4121-80e2-8a54bedc6ed9 tempest-GroupSnapshotsV319Test-1737935141 None] group_snapshot e58c41e6-89ef-463e-9b58-dbf2e57a65fb: deleted successfully Jun 29 11:11:17 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3dfef8fc-3df7-4eb5-8309-9a9043c15d60 tempest-GroupSnapshotsV319Test-1737935141 None] Acquiring lock "cinder-quobyte-ed822b07-1c1c-4d27-b28c-cfc785fdba70" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:11:17 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3dfef8fc-3df7-4eb5-8309-9a9043c15d60 tempest-GroupSnapshotsV319Test-1737935141 None] Lock "cinder-quobyte-ed822b07-1c1c-4d27-b28c-cfc785fdba70" acquired by "delete_volume" :: waited 0.043s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:11:17 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb768d7-d10e-47e5-9d13-9817e8838882]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:11:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3dfef8fc-3df7-4eb5-8309-9a9043c15d60 tempest-GroupSnapshotsV319Test-1737935141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:17 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70 Jun 29 11:11:17 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:18 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3dfef8fc-3df7-4eb5-8309-9a9043c15d60 tempest-GroupSnapshotsV319Test-1737935141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70" returned: 0 in 1.018s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3dfef8fc-3df7-4eb5-8309-9a9043c15d60 tempest-GroupSnapshotsV319Test-1737935141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:18 devstack sudo[101067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70 Jun 29 11:11:18 devstack sudo[101067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:19 devstack sudo[101067]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3dfef8fc-3df7-4eb5-8309-9a9043c15d60 tempest-GroupSnapshotsV319Test-1737935141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ed822b07-1c1c-4d27-b28c-cfc785fdba70" returned: 0 in 0.819s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:19 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3dfef8fc-3df7-4eb5-8309-9a9043c15d60 tempest-GroupSnapshotsV319Test-1737935141 None] Lock "cinder-quobyte-ed822b07-1c1c-4d27-b28c-cfc785fdba70" released by "delete_volume" :: held 2.044s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:11:19 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-3dfef8fc-3df7-4eb5-8309-9a9043c15d60 tempest-GroupSnapshotsV319Test-1737935141 None] Created reservations ['fd80c822-d45b-4a9d-8b54-e2141636100a'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:11:19 devstack cinder-volume[93497]: WARNING cinder.quota [None req-3dfef8fc-3df7-4eb5-8309-9a9043c15d60 tempest-GroupSnapshotsV319Test-1737935141 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-463185810 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-463185810, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:11:19 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-3dfef8fc-3df7-4eb5-8309-9a9043c15d60 tempest-GroupSnapshotsV319Test-1737935141 None] Created reservations ['1119c737-3296-470a-96e3-dbad7aea8a4e', '8bc86004-d839-4644-b18d-e88de4f9e9d4', '24cafa83-18ca-41c8-b2af-c8470cfa8cc3', '4b22a528-347c-4cb3-84cc-362972e50c24'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:11:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3dfef8fc-3df7-4eb5-8309-9a9043c15d60 tempest-GroupSnapshotsV319Test-1737935141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:11:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3dfef8fc-3df7-4eb5-8309-9a9043c15d60 tempest-GroupSnapshotsV319Test-1737935141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:11:19 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-3dfef8fc-3df7-4eb5-8309-9a9043c15d60 tempest-GroupSnapshotsV319Test-1737935141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:11:19 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-3dfef8fc-3df7-4eb5-8309-9a9043c15d60 tempest-GroupSnapshotsV319Test-1737935141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:11:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3dfef8fc-3df7-4eb5-8309-9a9043c15d60 tempest-GroupSnapshotsV319Test-1737935141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:11:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3dfef8fc-3df7-4eb5-8309-9a9043c15d60 tempest-GroupSnapshotsV319Test-1737935141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:19 devstack sudo[101070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:11:19 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:20 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3dfef8fc-3df7-4eb5-8309-9a9043c15d60 tempest-GroupSnapshotsV319Test-1737935141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.670s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:20 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-3dfef8fc-3df7-4eb5-8309-9a9043c15d60 tempest-GroupSnapshotsV319Test-1737935141 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:11:20 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-3dfef8fc-3df7-4eb5-8309-9a9043c15d60 tempest-GroupSnapshotsV319Test-1737935141 None] Delete group completed successfully. Jun 29 11:11:29 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:UPDATE=29,cinder:SELECT=26,cinder:INSERT=7 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:11:29 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=39,cinder:UPDATE=24,cinder:DELETE=1,cinder:INSERT=6 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:11:36 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:11:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] Flow 'volume_create_manager' (71e8b2e6-617f-4518-8bfe-6c83e98f4ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:11:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9e6bff3-27e6-465d-a57d-2569d4ce858f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:11:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9e6bff3-27e6-465d-a57d-2569d4ce858f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1083703703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7762ed4d-a09f-418c-90ad-0453ded6b1f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a804853575b469fa9709eac77b5b1b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:11:36Z,use_quota=True,user_id='b97c69a8fd47438cbcfa4a27710eba35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:11:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95307bd6-df75-425d-8a06-92173052e8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:11:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95307bd6-df75-425d-8a06-92173052e8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:11:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29ff1172-e26a-48b2-9c08-ae7059b51b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:11:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29ff1172-e26a-48b2-9c08-ae7059b51b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7762ed4d-a09f-418c-90ad-0453ded6b1f0', 'volume_name': 'volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:11:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b753b3-e9df-4279-9493-508379fe61f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:11:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b753b3-e9df-4279-9493-508379fe61f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:11:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dece3203-c4d0-4f57-a749-bf07dc536a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:11:36 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] Volume 7762ed4d-a09f-418c-90ad-0453ded6b1f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0', 'volume_size': 1} Jun 29 11:11:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:11:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:11:36 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1083703703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7762ed4d-a09f-418c-90ad-0453ded6b1f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a804853575b469fa9709eac77b5b1b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:11:36Z,use_quota=True,user_id='b97c69a8fd47438cbcfa4a27710eba35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:11:36 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] Creating volume 7762ed4d-a09f-418c-90ad-0453ded6b1f0 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:11:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:11:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:11:36 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:11:36 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:11:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:11:36 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:11:36 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:11:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:36 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0 1073741824 Jun 29 11:11:36 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:38 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0 1073741824" returned: 0 in 2.119s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:38 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0 Jun 29 11:11:38 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:39 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0" returned: 0 in 1.363s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:39 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] <== create_volume: return (3555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:11:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.558s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:11:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dece3203-c4d0-4f57-a749-bf07dc536a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:11:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17350f76-fa8e-401b-adde-67dba05a5bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:11:39 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] Volume volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0 (7762ed4d-a09f-418c-90ad-0453ded6b1f0): created successfully Jun 29 11:11:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17350f76-fa8e-401b-adde-67dba05a5bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:11:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] Flow 'volume_create_manager' (71e8b2e6-617f-4518-8bfe-6c83e98f4ce8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:11:40 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-96d9109c-bc3f-4306-8181-cf28f5a98bd7 tempest-SnapshotsActionsTest-1787185938 None] Created volume successfully. Jun 29 11:11:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8110e77c-ddc9-45ef-8857-514866420dbe tempest-SnapshotsActionsTest-1787185938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:11:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8110e77c-ddc9-45ef-8857-514866420dbe tempest-SnapshotsActionsTest-1787185938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:11:41 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-8110e77c-ddc9-45ef-8857-514866420dbe tempest-SnapshotsActionsTest-1787185938 None] Creating offline snapshot 5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 of volume 7762ed4d-a09f-418c-90ad-0453ded6b1f0 {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:11:41 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[66aec1cb-9634-4bb6-8808-f10e08f8e7f8]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:11:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8110e77c-ddc9-45ef-8857-514866420dbe tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:42 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0 Jun 29 11:11:42 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:42 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fa63cc03-f658-49e1-af54-148b5a75f609 tempest-VolumesActionsTest-144281045 None] Acquiring lock "cinder-e415c41e-6257-4ff9-8e36-2b61750b7e86" by "attach_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:11:42 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fa63cc03-f658-49e1-af54-148b5a75f609 tempest-VolumesActionsTest-144281045 None] Lock "cinder-e415c41e-6257-4ff9-8e36-2b61750b7e86" acquired by "attach_volume" :: waited 0.073s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:11:42 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-fa63cc03-f658-49e1-af54-148b5a75f609 tempest-VolumesActionsTest-144281045 None] Attaching volume e415c41e-6257-4ff9-8e36-2b61750b7e86 to instance fd6390f4-9157-4298-84b6-814e5603b58a at mountpoint /dev/vdb on host None. Jun 29 11:11:42 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-fa63cc03-f658-49e1-af54-148b5a75f609 tempest-VolumesActionsTest-144281045 None] Attach volume completed successfully. Jun 29 11:11:42 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fa63cc03-f658-49e1-af54-148b5a75f609 tempest-VolumesActionsTest-144281045 None] Lock "cinder-e415c41e-6257-4ff9-8e36-2b61750b7e86" released by "attach_volume" :: held 0.283s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:11:43 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-71b3641a-b895-4257-99be-0edf0ced9cc4 tempest-VolumesActionsTest-144281045 None] Acquiring lock "cinder-e415c41e-6257-4ff9-8e36-2b61750b7e86-detach_volume" by "detach_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:11:43 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-71b3641a-b895-4257-99be-0edf0ced9cc4 tempest-VolumesActionsTest-144281045 None] Lock "cinder-e415c41e-6257-4ff9-8e36-2b61750b7e86-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:11:43 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-71b3641a-b895-4257-99be-0edf0ced9cc4 tempest-VolumesActionsTest-144281045 None] Detaching volume e415c41e-6257-4ff9-8e36-2b61750b7e86 from instance fd6390f4-9157-4298-84b6-814e5603b58a. Jun 29 11:11:43 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-71b3641a-b895-4257-99be-0edf0ced9cc4 tempest-VolumesActionsTest-144281045 None] Detach volume completed successfully. Jun 29 11:11:43 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-71b3641a-b895-4257-99be-0edf0ced9cc4 tempest-VolumesActionsTest-144281045 None] Lock "cinder-e415c41e-6257-4ff9-8e36-2b61750b7e86-detach_volume" released by "detach_volume" :: held 0.089s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:11:43 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8110e77c-ddc9-45ef-8857-514866420dbe tempest-SnapshotsActionsTest-1787185938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0" returned: 0 in 1.940s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8110e77c-ddc9-45ef-8857-514866420dbe tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:43 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 1G Jun 29 11:11:43 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:45 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8110e77c-ddc9-45ef-8857-514866420dbe tempest-SnapshotsActionsTest-1787185938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 1G" returned: 0 in 1.423s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8110e77c-ddc9-45ef-8857-514866420dbe tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:45 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 Jun 29 11:11:45 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:46 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8110e77c-ddc9-45ef-8857-514866420dbe tempest-SnapshotsActionsTest-1787185938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4" returned: 0 in 1.443s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:46 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-8110e77c-ddc9-45ef-8857-514866420dbe tempest-SnapshotsActionsTest-1787185938 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 is being set with open permissions: ugo+rw Jun 29 11:11:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8110e77c-ddc9-45ef-8857-514866420dbe tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:46 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 Jun 29 11:11:46 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:47 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8110e77c-ddc9-45ef-8857-514866420dbe tempest-SnapshotsActionsTest-1787185938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4" returned: 0 in 0.850s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8110e77c-ddc9-45ef-8857-514866420dbe tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:47 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.info Jun 29 11:11:47 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:48 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8110e77c-ddc9-45ef-8857-514866420dbe tempest-SnapshotsActionsTest-1787185938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.info" returned: 0 in 0.929s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:48 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-8110e77c-ddc9-45ef-8857-514866420dbe tempest-SnapshotsActionsTest-1787185938 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.info is being set with open permissions: ugo+rw Jun 29 11:11:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8110e77c-ddc9-45ef-8857-514866420dbe tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:48 devstack sudo[101457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.info Jun 29 11:11:48 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:49 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8110e77c-ddc9-45ef-8857-514866420dbe tempest-SnapshotsActionsTest-1787185938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.info" returned: 0 in 0.771s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8110e77c-ddc9-45ef-8857-514866420dbe tempest-SnapshotsActionsTest-1787185938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.574s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:11:49 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-8110e77c-ddc9-45ef-8857-514866420dbe tempest-SnapshotsActionsTest-1787185938 None] Create snapshot completed successfully Jun 29 11:11:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0512e36a-512c-4c24-8ea9-e376a3d4f177 tempest-SnapshotsActionsTest-1787185938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:11:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0512e36a-512c-4c24-8ea9-e376a3d4f177 tempest-SnapshotsActionsTest-1787185938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:11:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-0512e36a-512c-4c24-8ea9-e376a3d4f177 tempest-SnapshotsActionsTest-1787185938 None] Creating offline snapshot 32285033-740e-4e6a-aa0a-b6602f330d9f of volume 7762ed4d-a09f-418c-90ad-0453ded6b1f0 {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:11:50 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c8d667-770b-4b18-b41c-d4dbee144401]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:11:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0512e36a-512c-4c24-8ea9-e376a3d4f177 tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:51 devstack sudo[101460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 Jun 29 11:11:51 devstack sudo[101460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:51 devstack sudo[101460]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0512e36a-512c-4c24-8ea9-e376a3d4f177 tempest-SnapshotsActionsTest-1787185938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4" returned: 0 in 0.864s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-0512e36a-512c-4c24-8ea9-e376a3d4f177 tempest-SnapshotsActionsTest-1787185938 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:11:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0512e36a-512c-4c24-8ea9-e376a3d4f177 tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.32285033-740e-4e6a-aa0a-b6602f330d9f 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:51 devstack sudo[101465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.32285033-740e-4e6a-aa0a-b6602f330d9f 1G Jun 29 11:11:51 devstack sudo[101465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:52 devstack sudo[101465]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0512e36a-512c-4c24-8ea9-e376a3d4f177 tempest-SnapshotsActionsTest-1787185938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.32285033-740e-4e6a-aa0a-b6602f330d9f 1G" returned: 0 in 1.007s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0512e36a-512c-4c24-8ea9-e376a3d4f177 tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.32285033-740e-4e6a-aa0a-b6602f330d9f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:52 devstack sudo[101471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.32285033-740e-4e6a-aa0a-b6602f330d9f Jun 29 11:11:52 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4f6c35ea-5a98-4173-b3ca-f241a862a45b tempest-VolumesActionsTest-144281045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:11:53 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0512e36a-512c-4c24-8ea9-e376a3d4f177 tempest-SnapshotsActionsTest-1787185938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.32285033-740e-4e6a-aa0a-b6602f330d9f" returned: 0 in 0.768s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:53 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-0512e36a-512c-4c24-8ea9-e376a3d4f177 tempest-SnapshotsActionsTest-1787185938 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.32285033-740e-4e6a-aa0a-b6602f330d9f is being set with open permissions: ugo+rw Jun 29 11:11:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0512e36a-512c-4c24-8ea9-e376a3d4f177 tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.32285033-740e-4e6a-aa0a-b6602f330d9f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:53 devstack sudo[101476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.32285033-740e-4e6a-aa0a-b6602f330d9f Jun 29 11:11:53 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:54 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0512e36a-512c-4c24-8ea9-e376a3d4f177 tempest-SnapshotsActionsTest-1787185938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.32285033-740e-4e6a-aa0a-b6602f330d9f" returned: 0 in 0.661s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0512e36a-512c-4c24-8ea9-e376a3d4f177 tempest-SnapshotsActionsTest-1787185938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.418s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:11:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4f6c35ea-5a98-4173-b3ca-f241a862a45b tempest-VolumesActionsTest-144281045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.741s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:11:54 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d6a800-cbb0-4d20-964d-9c027657faa4]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:11:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4f6c35ea-5a98-4173-b3ca-f241a862a45b tempest-VolumesActionsTest-144281045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:54 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-0512e36a-512c-4c24-8ea9-e376a3d4f177 tempest-SnapshotsActionsTest-1787185938 None] Create snapshot completed successfully Jun 29 11:11:54 devstack sudo[101479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86 Jun 29 11:11:54 devstack sudo[101479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:55 devstack sudo[101479]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4f6c35ea-5a98-4173-b3ca-f241a862a45b tempest-VolumesActionsTest-144281045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86" returned: 0 in 0.847s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:55 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[097bcfb3-3e06-4f07-a901-5de377212c26]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:11:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4f6c35ea-5a98-4173-b3ca-f241a862a45b tempest-VolumesActionsTest-144281045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-29a327f7-2c99-4222-83d2-e8ec302f9ffb tempest-SnapshotsActionsTest-1971824292 None] Acquiring lock "cinder-32285033-740e-4e6a-aa0a-b6602f330d9f-delete_snapshot" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:11:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-29a327f7-2c99-4222-83d2-e8ec302f9ffb tempest-SnapshotsActionsTest-1971824292 None] Lock "cinder-32285033-740e-4e6a-aa0a-b6602f330d9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:11:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-29a327f7-2c99-4222-83d2-e8ec302f9ffb tempest-SnapshotsActionsTest-1971824292 None] Acquiring lock "cinder-quobyte-7762ed4d-a09f-418c-90ad-0453ded6b1f0" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:11:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-29a327f7-2c99-4222-83d2-e8ec302f9ffb tempest-SnapshotsActionsTest-1971824292 None] Lock "cinder-quobyte-7762ed4d-a09f-418c-90ad-0453ded6b1f0" acquired by "delete_snapshot" :: waited 0.039s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:11:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-29a327f7-2c99-4222-83d2-e8ec302f9ffb tempest-SnapshotsActionsTest-1971824292 None] Acquiring lock "cinder-quobyte-32285033-740e-4e6a-aa0a-b6602f330d9f" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:11:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-29a327f7-2c99-4222-83d2-e8ec302f9ffb tempest-SnapshotsActionsTest-1971824292 None] Lock "cinder-quobyte-32285033-740e-4e6a-aa0a-b6602f330d9f" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:11:55 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-29a327f7-2c99-4222-83d2-e8ec302f9ffb tempest-SnapshotsActionsTest-1971824292 None] Deleting offline snapshot 32285033-740e-4e6a-aa0a-b6602f330d9f of volume 7762ed4d-a09f-418c-90ad-0453ded6b1f0 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:11:55 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-29a327f7-2c99-4222-83d2-e8ec302f9ffb tempest-SnapshotsActionsTest-1971824292 None] snapshot_file for this snap is: volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.32285033-740e-4e6a-aa0a-b6602f330d9f {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:11:55 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f261aca1-cb20-465a-83de-fe44c0c165a5]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:11:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-29a327f7-2c99-4222-83d2-e8ec302f9ffb tempest-SnapshotsActionsTest-1971824292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.32285033-740e-4e6a-aa0a-b6602f330d9f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:55 devstack sudo[101484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86 Jun 29 11:11:55 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:55 devstack sudo[101486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.32285033-740e-4e6a-aa0a-b6602f330d9f Jun 29 11:11:55 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:56 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4f6c35ea-5a98-4173-b3ca-f241a862a45b tempest-VolumesActionsTest-144281045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86" returned: 0 in 0.951s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4f6c35ea-5a98-4173-b3ca-f241a862a45b tempest-VolumesActionsTest-144281045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86 /opt/stack/data/cinder/conversion/e415c41e-6257-4ff9-8e36-2b61750b7e86.temp_image.a878eb74-4b0e-445a-9516-8d408ac0b73co5vx9hxw.img {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:56 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86 /opt/stack/data/cinder/conversion/e415c41e-6257-4ff9-8e36-2b61750b7e86.temp_image.a878eb74-4b0e-445a-9516-8d408ac0b73co5vx9hxw.img Jun 29 11:11:56 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:56 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-29a327f7-2c99-4222-83d2-e8ec302f9ffb tempest-SnapshotsActionsTest-1971824292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.32285033-740e-4e6a-aa0a-b6602f330d9f" returned: 0 in 0.828s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-29a327f7-2c99-4222-83d2-e8ec302f9ffb tempest-SnapshotsActionsTest-1971824292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:11:56 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0fa407-0430-451f-8eda-62b605309629]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:11:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-29a327f7-2c99-4222-83d2-e8ec302f9ffb tempest-SnapshotsActionsTest-1971824292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:56 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 Jun 29 11:11:56 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:57 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-29a327f7-2c99-4222-83d2-e8ec302f9ffb tempest-SnapshotsActionsTest-1971824292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4" returned: 0 in 0.923s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:57 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-29a327f7-2c99-4222-83d2-e8ec302f9ffb tempest-SnapshotsActionsTest-1971824292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:11:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-29a327f7-2c99-4222-83d2-e8ec302f9ffb tempest-SnapshotsActionsTest-1971824292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.32285033-740e-4e6a-aa0a-b6602f330d9f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:57 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.32285033-740e-4e6a-aa0a-b6602f330d9f Jun 29 11:11:57 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:11:59 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Jun 29 11:11:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-29a327f7-2c99-4222-83d2-e8ec302f9ffb tempest-SnapshotsActionsTest-1971824292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.32285033-740e-4e6a-aa0a-b6602f330d9f" returned: 0 in 2.702s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:11:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-29a327f7-2c99-4222-83d2-e8ec302f9ffb tempest-SnapshotsActionsTest-1971824292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.32285033-740e-4e6a-aa0a-b6602f330d9f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:11:59 devstack sudo[101523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.32285033-740e-4e6a-aa0a-b6602f330d9f Jun 29 11:12:00 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:00 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:12:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] Flow 'volume_create_manager' (ea617fe0-3114-4e0d-a17c-3e21d9e064e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:12:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8109cf8-814d-4602-8b60-aac6e3a9d627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:12:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8109cf8-814d-4602-8b60-aac6e3a9d627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-155980357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a967540-94c4-4de5-9499-b9508eb0a5fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6152cfa9d1478d850e417348a1c4dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:12:01Z,use_quota=True,user_id='62e68c840d124d71b52de38778cc57d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:12:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a280271a-0bd1-4a1a-b7d6-0cd0728816de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:12:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a280271a-0bd1-4a1a-b7d6-0cd0728816de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:12:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0821e806-1f24-42fb-aac3-a25319e61e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:12:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0821e806-1f24-42fb-aac3-a25319e61e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a967540-94c4-4de5-9499-b9508eb0a5fb', 'volume_name': 'volume-3a967540-94c4-4de5-9499-b9508eb0a5fb', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:12:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3270b74c-40d0-43fd-ad68-d209af4b6561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:12:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3270b74c-40d0-43fd-ad68-d209af4b6561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:12:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc99241a-de87-4845-8e10-ac31eed65533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:12:00 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] Volume 3a967540-94c4-4de5-9499-b9508eb0a5fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a967540-94c4-4de5-9499-b9508eb0a5fb', 'volume_size': 1} Jun 29 11:12:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:12:01 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-29a327f7-2c99-4222-83d2-e8ec302f9ffb tempest-SnapshotsActionsTest-1971824292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.32285033-740e-4e6a-aa0a-b6602f330d9f" returned: 0 in 1.929s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-29a327f7-2c99-4222-83d2-e8ec302f9ffb tempest-SnapshotsActionsTest-1971824292 None] Lock "cinder-quobyte-32285033-740e-4e6a-aa0a-b6602f330d9f" released by "_delete_snapshot" :: held 6.562s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:12:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-29a327f7-2c99-4222-83d2-e8ec302f9ffb tempest-SnapshotsActionsTest-1971824292 None] Lock "cinder-quobyte-7762ed4d-a09f-418c-90ad-0453ded6b1f0" released by "delete_snapshot" :: held 6.615s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:12:02 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-29a327f7-2c99-4222-83d2-e8ec302f9ffb tempest-SnapshotsActionsTest-1971824292 None] Created reservations ['79d6766e-e8d6-4354-95d3-647c36ebe99e', 'd4dee8d8-104c-4043-b891-d1f807ce50c2', '9c4d522a-24ae-4f55-ba2a-1bb19db30938', '98c33f6b-0cf3-486d-81d6-c47a48eff567'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:12:02 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-29a327f7-2c99-4222-83d2-e8ec302f9ffb tempest-SnapshotsActionsTest-1971824292 None] Delete snapshot completed successfully. Jun 29 11:12:02 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-29a327f7-2c99-4222-83d2-e8ec302f9ffb tempest-SnapshotsActionsTest-1971824292 None] Lock "cinder-32285033-740e-4e6a-aa0a-b6602f330d9f-delete_snapshot" released by "delete_snapshot" :: held 7.169s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:12:02 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4f6c35ea-5a98-4173-b3ca-f241a862a45b tempest-VolumesActionsTest-144281045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86 /opt/stack/data/cinder/conversion/e415c41e-6257-4ff9-8e36-2b61750b7e86.temp_image.a878eb74-4b0e-445a-9516-8d408ac0b73co5vx9hxw.img" returned: 0 in 6.463s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:02 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[220754d0-60a9-466d-b738-804e2a45b0db]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:12:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4f6c35ea-5a98-4173-b3ca-f241a862a45b tempest-VolumesActionsTest-144281045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:02 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86 Jun 29 11:12:02 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c200102d-3b73-4c87-9053-6ccad5f92174 tempest-SnapshotsActionsTest-1787185938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:12:03 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4f6c35ea-5a98-4173-b3ca-f241a862a45b tempest-VolumesActionsTest-144281045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86" returned: 0 in 1.086s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:03 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-4f6c35ea-5a98-4173-b3ca-f241a862a45b tempest-VolumesActionsTest-144281045 None] Image conversion details: src /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86, size 1024.00 MB, duration 6.46 sec, destination /opt/stack/data/cinder/conversion/e415c41e-6257-4ff9-8e36-2b61750b7e86.temp_image.a878eb74-4b0e-445a-9516-8d408ac0b73co5vx9hxw.img {{(pid=93497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 11:12:03 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-4f6c35ea-5a98-4173-b3ca-f241a862a45b tempest-VolumesActionsTest-144281045 None] Converted 1024.00 MB image at 158.42 MB/s Jun 29 11:12:03 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-4f6c35ea-5a98-4173-b3ca-f241a862a45b tempest-VolumesActionsTest-144281045 None] a878eb74-4b0e-445a-9516-8d408ac0b73c was raw, no need to convert to raw {{(pid=93497) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 29 11:12:08 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:12:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:12:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:12:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:12:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:12:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:12:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:08 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:12:08 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:08 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.714s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:08 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:12:08 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager._thread_info {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:12:08 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread count: 28 {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 11:12:08 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread info: [<_MainThread(MainThread, started 131117520400512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 11:12:12 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=23,cinder:UPDATE=14,cinder:DELETE=2,cinder:INSERT=2 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:12:13 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:UPDATE=16,cinder:SELECT=21,cinder:INSERT=6,cinder:DELETE=1 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:12:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4f6c35ea-5a98-4173-b3ca-f241a862a45b tempest-VolumesActionsTest-144281045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.892s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:12:26 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4f6c35ea-5a98-4173-b3ca-f241a862a45b tempest-VolumesActionsTest-144281045 None] Uploaded volume to glance image-id: a878eb74-4b0e-445a-9516-8d408ac0b73c. {{(pid=93497) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 29 11:12:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.277s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:12:26 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-155980357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a967540-94c4-4de5-9499-b9508eb0a5fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6152cfa9d1478d850e417348a1c4dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:12:01Z,use_quota=True,user_id='62e68c840d124d71b52de38778cc57d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:12:26 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] Creating volume 3a967540-94c4-4de5-9499-b9508eb0a5fb {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:12:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:12:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:12:26 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:12:26 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:12:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:12:26 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:12:26 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:12:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-3a967540-94c4-4de5-9499-b9508eb0a5fb 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:26 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-3a967540-94c4-4de5-9499-b9508eb0a5fb 1073741824 Jun 29 11:12:26 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:26 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-4f6c35ea-5a98-4173-b3ca-f241a862a45b tempest-VolumesActionsTest-144281045 None] Copy volume to image completed successfully. Jun 29 11:12:27 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-3a967540-94c4-4de5-9499-b9508eb0a5fb 1073741824" returned: 0 in 0.881s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-3a967540-94c4-4de5-9499-b9508eb0a5fb {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:27 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-3a967540-94c4-4de5-9499-b9508eb0a5fb Jun 29 11:12:27 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4c2ef556-f0fc-48e0-b47b-a8f75e19a1e2 tempest-VolumesActionsTest-144281045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:12:27 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-3a967540-94c4-4de5-9499-b9508eb0a5fb" returned: 0 in 0.673s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:27 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:12:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:12:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c200102d-3b73-4c87-9053-6ccad5f92174 tempest-SnapshotsActionsTest-1787185938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 24.434s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:12:27 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-c200102d-3b73-4c87-9053-6ccad5f92174 tempest-SnapshotsActionsTest-1787185938 None] Creating offline snapshot 2591f5c0-9c98-47f1-b392-7b3f94eff398 of volume 7762ed4d-a09f-418c-90ad-0453ded6b1f0 {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:12:27 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc99241a-de87-4845-8e10-ac31eed65533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a967540-94c4-4de5-9499-b9508eb0a5fb', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:12:27 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aacee8a-ce4b-4d4f-974c-800a3a172b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:12:27 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ed7d26-e765-44b0-8540-ef655b358a56]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:12:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c200102d-3b73-4c87-9053-6ccad5f92174 tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:27 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] Volume volume-3a967540-94c4-4de5-9499-b9508eb0a5fb (3a967540-94c4-4de5-9499-b9508eb0a5fb): created successfully Jun 29 11:12:27 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aacee8a-ce4b-4d4f-974c-800a3a172b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:12:27 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] Flow 'volume_create_manager' (ea617fe0-3114-4e0d-a17c-3e21d9e064e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:12:27 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-ab973c23-e055-42dc-a638-54854c32817b tempest-AttachVolumeNegativeTest-1748370238 None] Created volume successfully. Jun 29 11:12:27 devstack sudo[101722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 Jun 29 11:12:27 devstack sudo[101722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:28 devstack sudo[101722]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c200102d-3b73-4c87-9053-6ccad5f92174 tempest-SnapshotsActionsTest-1787185938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4" returned: 0 in 0.783s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:28 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-c200102d-3b73-4c87-9053-6ccad5f92174 tempest-SnapshotsActionsTest-1787185938 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:12:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c200102d-3b73-4c87-9053-6ccad5f92174 tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.2591f5c0-9c98-47f1-b392-7b3f94eff398 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:28 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.2591f5c0-9c98-47f1-b392-7b3f94eff398 1G Jun 29 11:12:28 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:29 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c200102d-3b73-4c87-9053-6ccad5f92174 tempest-SnapshotsActionsTest-1787185938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.2591f5c0-9c98-47f1-b392-7b3f94eff398 1G" returned: 0 in 0.905s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c200102d-3b73-4c87-9053-6ccad5f92174 tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.2591f5c0-9c98-47f1-b392-7b3f94eff398 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:29 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.2591f5c0-9c98-47f1-b392-7b3f94eff398 Jun 29 11:12:29 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:30 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c200102d-3b73-4c87-9053-6ccad5f92174 tempest-SnapshotsActionsTest-1787185938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.2591f5c0-9c98-47f1-b392-7b3f94eff398" returned: 0 in 0.728s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:30 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-c200102d-3b73-4c87-9053-6ccad5f92174 tempest-SnapshotsActionsTest-1787185938 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.2591f5c0-9c98-47f1-b392-7b3f94eff398 is being set with open permissions: ugo+rw Jun 29 11:12:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c200102d-3b73-4c87-9053-6ccad5f92174 tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.2591f5c0-9c98-47f1-b392-7b3f94eff398 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:30 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.2591f5c0-9c98-47f1-b392-7b3f94eff398 Jun 29 11:12:30 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:30 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c200102d-3b73-4c87-9053-6ccad5f92174 tempest-SnapshotsActionsTest-1787185938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.2591f5c0-9c98-47f1-b392-7b3f94eff398" returned: 0 in 0.706s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c200102d-3b73-4c87-9053-6ccad5f92174 tempest-SnapshotsActionsTest-1787185938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.235s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:12:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4c2ef556-f0fc-48e0-b47b-a8f75e19a1e2 tempest-VolumesActionsTest-144281045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.569s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:12:31 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[90607dff-cdff-4b51-86d1-b85b6bc89bde]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:12:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4c2ef556-f0fc-48e0-b47b-a8f75e19a1e2 tempest-VolumesActionsTest-144281045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:31 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-c200102d-3b73-4c87-9053-6ccad5f92174 tempest-SnapshotsActionsTest-1787185938 None] Create snapshot completed successfully Jun 29 11:12:31 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86 Jun 29 11:12:31 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-87bbce45-0f74-4ff5-8eca-6b34fb9792ab req-e00bc45a-3c8d-41fa-8593-c9188e08e097 tempest-AttachVolumeNegativeTest-1748370238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:12:32 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-41a2b657-654f-49d4-b876-5ffa9e7df52d tempest-SnapshotsActionsTest-1971824292 None] Acquiring lock "cinder-2591f5c0-9c98-47f1-b392-7b3f94eff398-delete_snapshot" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:12:32 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-41a2b657-654f-49d4-b876-5ffa9e7df52d tempest-SnapshotsActionsTest-1971824292 None] Lock "cinder-2591f5c0-9c98-47f1-b392-7b3f94eff398-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:12:32 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-41a2b657-654f-49d4-b876-5ffa9e7df52d tempest-SnapshotsActionsTest-1971824292 None] Acquiring lock "cinder-quobyte-7762ed4d-a09f-418c-90ad-0453ded6b1f0" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:12:32 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:32 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-41a2b657-654f-49d4-b876-5ffa9e7df52d tempest-SnapshotsActionsTest-1971824292 None] Lock "cinder-quobyte-7762ed4d-a09f-418c-90ad-0453ded6b1f0" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:12:32 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-41a2b657-654f-49d4-b876-5ffa9e7df52d tempest-SnapshotsActionsTest-1971824292 None] Acquiring lock "cinder-quobyte-2591f5c0-9c98-47f1-b392-7b3f94eff398" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:12:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4c2ef556-f0fc-48e0-b47b-a8f75e19a1e2 tempest-VolumesActionsTest-144281045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86" returned: 0 in 0.993s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:32 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-41a2b657-654f-49d4-b876-5ffa9e7df52d tempest-SnapshotsActionsTest-1971824292 None] Lock "cinder-quobyte-2591f5c0-9c98-47f1-b392-7b3f94eff398" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:12:32 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-41a2b657-654f-49d4-b876-5ffa9e7df52d tempest-SnapshotsActionsTest-1971824292 None] Deleting offline snapshot 2591f5c0-9c98-47f1-b392-7b3f94eff398 of volume 7762ed4d-a09f-418c-90ad-0453ded6b1f0 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:12:32 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-41a2b657-654f-49d4-b876-5ffa9e7df52d tempest-SnapshotsActionsTest-1971824292 None] snapshot_file for this snap is: volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.2591f5c0-9c98-47f1-b392-7b3f94eff398 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:12:32 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6b4984-cca6-4952-970a-39ba44c21685]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:12:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4c2ef556-f0fc-48e0-b47b-a8f75e19a1e2 tempest-VolumesActionsTest-144281045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:32 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1e2b45-e54e-4c2a-9675-bd208cc74642]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:12:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-41a2b657-654f-49d4-b876-5ffa9e7df52d tempest-SnapshotsActionsTest-1971824292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.2591f5c0-9c98-47f1-b392-7b3f94eff398 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:32 devstack sudo[101755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.2591f5c0-9c98-47f1-b392-7b3f94eff398 Jun 29 11:12:32 devstack sudo[101755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:32 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86 Jun 29 11:12:32 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:32 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4c2ef556-f0fc-48e0-b47b-a8f75e19a1e2 tempest-VolumesActionsTest-144281045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86" returned: 0 in 0.850s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4c2ef556-f0fc-48e0-b47b-a8f75e19a1e2 tempest-VolumesActionsTest-144281045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86 /opt/stack/data/cinder/conversion/e415c41e-6257-4ff9-8e36-2b61750b7e86.temp_image.4e052e69-bb9f-409e-abe7-79cb45f46576djh23wjc.img {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:32 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86 /opt/stack/data/cinder/conversion/e415c41e-6257-4ff9-8e36-2b61750b7e86.temp_image.4e052e69-bb9f-409e-abe7-79cb45f46576djh23wjc.img Jun 29 11:12:32 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:33 devstack sudo[101755]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-41a2b657-654f-49d4-b876-5ffa9e7df52d tempest-SnapshotsActionsTest-1971824292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.2591f5c0-9c98-47f1-b392-7b3f94eff398" returned: 0 in 0.964s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:33 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-41a2b657-654f-49d4-b876-5ffa9e7df52d tempest-SnapshotsActionsTest-1971824292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:12:33 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3422fc-98e0-403c-adc4-941d03eca1cc]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:12:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-41a2b657-654f-49d4-b876-5ffa9e7df52d tempest-SnapshotsActionsTest-1971824292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:33 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 Jun 29 11:12:33 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:34 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-41a2b657-654f-49d4-b876-5ffa9e7df52d tempest-SnapshotsActionsTest-1971824292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4" returned: 0 in 1.319s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:34 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-41a2b657-654f-49d4-b876-5ffa9e7df52d tempest-SnapshotsActionsTest-1971824292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:12:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-41a2b657-654f-49d4-b876-5ffa9e7df52d tempest-SnapshotsActionsTest-1971824292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.2591f5c0-9c98-47f1-b392-7b3f94eff398 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:34 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.2591f5c0-9c98-47f1-b392-7b3f94eff398 Jun 29 11:12:34 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:37 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-41a2b657-654f-49d4-b876-5ffa9e7df52d tempest-SnapshotsActionsTest-1971824292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.2591f5c0-9c98-47f1-b392-7b3f94eff398" returned: 0 in 2.591s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-41a2b657-654f-49d4-b876-5ffa9e7df52d tempest-SnapshotsActionsTest-1971824292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.2591f5c0-9c98-47f1-b392-7b3f94eff398 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:37 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.2591f5c0-9c98-47f1-b392-7b3f94eff398 Jun 29 11:12:37 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:37 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:12:37 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] Flow 'volume_create_manager' (535297c8-195c-4628-9528-0d9a974f5f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:12:37 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d53960-f467-433a-9fc4-b7ecd4e89055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:12:37 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d53960-f467-433a-9fc4-b7ecd4e89055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-937183600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=046572c5-1434-4ae5-9d01-6de1cdd2f86a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b96039928714c9b8c189bae3e1da70b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:12:37Z,use_quota=True,user_id='a6222c2687a041d18d5c1bb5ef11d4f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:12:37 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (938e6014-972c-4fdb-8e24-03dd7865b717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:12:37 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (938e6014-972c-4fdb-8e24-03dd7865b717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:12:37 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b132fc31-56e9-45c8-b608-67b11b4d6936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:12:37 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b132fc31-56e9-45c8-b608-67b11b4d6936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '046572c5-1434-4ae5-9d01-6de1cdd2f86a', 'volume_name': 'volume-046572c5-1434-4ae5-9d01-6de1cdd2f86a', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:12:37 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04675f20-8ca2-4f1a-b080-4ff42a93ea45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:12:37 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04675f20-8ca2-4f1a-b080-4ff42a93ea45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:12:37 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d4ebbbb-f031-43f9-af03-5fc9278b85ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:12:37 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] Volume 046572c5-1434-4ae5-9d01-6de1cdd2f86a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-046572c5-1434-4ae5-9d01-6de1cdd2f86a', 'volume_size': 1} Jun 29 11:12:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:12:38 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-41a2b657-654f-49d4-b876-5ffa9e7df52d tempest-SnapshotsActionsTest-1971824292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.2591f5c0-9c98-47f1-b392-7b3f94eff398" returned: 0 in 1.780s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:38 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4c2ef556-f0fc-48e0-b47b-a8f75e19a1e2 tempest-VolumesActionsTest-144281045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86 /opt/stack/data/cinder/conversion/e415c41e-6257-4ff9-8e36-2b61750b7e86.temp_image.4e052e69-bb9f-409e-abe7-79cb45f46576djh23wjc.img" returned: 0 in 5.895s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:38 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-41a2b657-654f-49d4-b876-5ffa9e7df52d tempest-SnapshotsActionsTest-1971824292 None] Lock "cinder-quobyte-2591f5c0-9c98-47f1-b392-7b3f94eff398" released by "_delete_snapshot" :: held 6.778s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:12:38 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-41a2b657-654f-49d4-b876-5ffa9e7df52d tempest-SnapshotsActionsTest-1971824292 None] Lock "cinder-quobyte-7762ed4d-a09f-418c-90ad-0453ded6b1f0" released by "delete_snapshot" :: held 6.805s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:12:38 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f695a620-6f51-4404-a66b-f85388420409]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:12:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4c2ef556-f0fc-48e0-b47b-a8f75e19a1e2 tempest-VolumesActionsTest-144281045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:38 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-41a2b657-654f-49d4-b876-5ffa9e7df52d tempest-SnapshotsActionsTest-1971824292 None] Created reservations ['886c7b8a-3bb3-4caa-9127-032c5fd9e9f4', '33744b01-566b-4f94-9b55-3e0ed915bf72', '45d17268-f662-4353-966a-b7238daa363a', '1a2545f8-caf4-4a7f-b0cf-de770e877c91'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:12:38 devstack sudo[101794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86 Jun 29 11:12:38 devstack sudo[101794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:38 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-41a2b657-654f-49d4-b876-5ffa9e7df52d tempest-SnapshotsActionsTest-1971824292 None] Delete snapshot completed successfully. Jun 29 11:12:38 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-41a2b657-654f-49d4-b876-5ffa9e7df52d tempest-SnapshotsActionsTest-1971824292 None] Lock "cinder-2591f5c0-9c98-47f1-b392-7b3f94eff398-delete_snapshot" released by "delete_snapshot" :: held 6.963s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:12:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-08ffe5f5-3078-4dba-9cb0-a99b0b37b858 tempest-SnapshotsActionsTest-1787185938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:12:39 devstack sudo[101794]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4c2ef556-f0fc-48e0-b47b-a8f75e19a1e2 tempest-VolumesActionsTest-144281045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86" returned: 0 in 0.978s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:39 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-4c2ef556-f0fc-48e0-b47b-a8f75e19a1e2 tempest-VolumesActionsTest-144281045 None] Image conversion details: src /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86, size 1024.00 MB, duration 5.90 sec, destination /opt/stack/data/cinder/conversion/e415c41e-6257-4ff9-8e36-2b61750b7e86.temp_image.4e052e69-bb9f-409e-abe7-79cb45f46576djh23wjc.img {{(pid=93497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 11:12:39 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-4c2ef556-f0fc-48e0-b47b-a8f75e19a1e2 tempest-VolumesActionsTest-144281045 None] Converted 1024.00 MB image at 173.67 MB/s Jun 29 11:12:39 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-4c2ef556-f0fc-48e0-b47b-a8f75e19a1e2 tempest-VolumesActionsTest-144281045 None] 4e052e69-bb9f-409e-abe7-79cb45f46576 was raw, converting to qcow2 {{(pid=93497) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 29 11:12:39 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[304d970e-9a39-4a7a-bb97-0fa2c06529ff]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:12:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4c2ef556-f0fc-48e0-b47b-a8f75e19a1e2 tempest-VolumesActionsTest-144281045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e415c41e-6257-4ff9-8e36-2b61750b7e86.temp_image.4e052e69-bb9f-409e-abe7-79cb45f46576djh23wjc.img {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:39 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e415c41e-6257-4ff9-8e36-2b61750b7e86.temp_image.4e052e69-bb9f-409e-abe7-79cb45f46576djh23wjc.img Jun 29 11:12:39 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:40 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4c2ef556-f0fc-48e0-b47b-a8f75e19a1e2 tempest-VolumesActionsTest-144281045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e415c41e-6257-4ff9-8e36-2b61750b7e86.temp_image.4e052e69-bb9f-409e-abe7-79cb45f46576djh23wjc.img" returned: 0 in 0.844s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4c2ef556-f0fc-48e0-b47b-a8f75e19a1e2 tempest-VolumesActionsTest-144281045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e415c41e-6257-4ff9-8e36-2b61750b7e86.temp_image.4e052e69-bb9f-409e-abe7-79cb45f46576djh23wjc.img {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:40 devstack sudo[101803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e415c41e-6257-4ff9-8e36-2b61750b7e86.temp_image.4e052e69-bb9f-409e-abe7-79cb45f46576djh23wjc.img Jun 29 11:12:40 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:41 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4c2ef556-f0fc-48e0-b47b-a8f75e19a1e2 tempest-VolumesActionsTest-144281045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e415c41e-6257-4ff9-8e36-2b61750b7e86.temp_image.4e052e69-bb9f-409e-abe7-79cb45f46576djh23wjc.img" returned: 1 in 0.788s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4c2ef556-f0fc-48e0-b47b-a8f75e19a1e2 tempest-VolumesActionsTest-144281045 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e415c41e-6257-4ff9-8e36-2b61750b7e86.temp_image.4e052e69-bb9f-409e-abe7-79cb45f46576djh23wjc.img' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:12:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4c2ef556-f0fc-48e0-b47b-a8f75e19a1e2 tempest-VolumesActionsTest-144281045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e415c41e-6257-4ff9-8e36-2b61750b7e86.temp_image.4e052e69-bb9f-409e-abe7-79cb45f46576djh23wjc.img /opt/stack/data/cinder/conversion/vol_upload_w9a1kqjm {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:41 devstack sudo[101808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e415c41e-6257-4ff9-8e36-2b61750b7e86.temp_image.4e052e69-bb9f-409e-abe7-79cb45f46576djh23wjc.img /opt/stack/data/cinder/conversion/vol_upload_w9a1kqjm Jun 29 11:12:41 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:42 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4c2ef556-f0fc-48e0-b47b-a8f75e19a1e2 tempest-VolumesActionsTest-144281045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e415c41e-6257-4ff9-8e36-2b61750b7e86.temp_image.4e052e69-bb9f-409e-abe7-79cb45f46576djh23wjc.img /opt/stack/data/cinder/conversion/vol_upload_w9a1kqjm" returned: 0 in 0.699s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:42 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-4c2ef556-f0fc-48e0-b47b-a8f75e19a1e2 tempest-VolumesActionsTest-144281045 None] Image conversion details: src /opt/stack/data/cinder/conversion/e415c41e-6257-4ff9-8e36-2b61750b7e86.temp_image.4e052e69-bb9f-409e-abe7-79cb45f46576djh23wjc.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_w9a1kqjm {{(pid=93497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 11:12:42 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-4c2ef556-f0fc-48e0-b47b-a8f75e19a1e2 tempest-VolumesActionsTest-144281045 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 29 11:12:42 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbbf9e6-0db9-409c-bb97-e2ac60b7eada]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:12:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4c2ef556-f0fc-48e0-b47b-a8f75e19a1e2 tempest-VolumesActionsTest-144281045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_w9a1kqjm {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:42 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_w9a1kqjm Jun 29 11:12:42 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:42 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4c2ef556-f0fc-48e0-b47b-a8f75e19a1e2 tempest-VolumesActionsTest-144281045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_w9a1kqjm" returned: 0 in 0.749s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4c2ef556-f0fc-48e0-b47b-a8f75e19a1e2 tempest-VolumesActionsTest-144281045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.270s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:12:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4c2ef556-f0fc-48e0-b47b-a8f75e19a1e2 tempest-VolumesActionsTest-144281045 None] Uploaded volume to glance image-id: 4e052e69-bb9f-409e-abe7-79cb45f46576. {{(pid=93497) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 29 11:12:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-87bbce45-0f74-4ff5-8eca-6b34fb9792ab req-e00bc45a-3c8d-41fa-8593-c9188e08e097 tempest-AttachVolumeNegativeTest-1748370238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.424s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:12:44 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c5aa77-2a45-46bc-a619-8e35e561e833]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:12:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-87bbce45-0f74-4ff5-8eca-6b34fb9792ab req-e00bc45a-3c8d-41fa-8593-c9188e08e097 tempest-AttachVolumeNegativeTest-1748370238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-3a967540-94c4-4de5-9499-b9508eb0a5fb {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:44 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-4c2ef556-f0fc-48e0-b47b-a8f75e19a1e2 tempest-VolumesActionsTest-144281045 None] Copy volume to image completed successfully. Jun 29 11:12:44 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-3a967540-94c4-4de5-9499-b9508eb0a5fb Jun 29 11:12:44 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:45 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1b76f5d9-d245-4201-a726-843e9a6dabbc tempest-VolumesActionsTest-144281045 None] Acquiring lock "cinder-e415c41e-6257-4ff9-8e36-2b61750b7e86-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:12:45 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1b76f5d9-d245-4201-a726-843e9a6dabbc tempest-VolumesActionsTest-144281045 None] Lock "cinder-e415c41e-6257-4ff9-8e36-2b61750b7e86-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:12:45 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1b76f5d9-d245-4201-a726-843e9a6dabbc tempest-VolumesActionsTest-144281045 None] Acquiring lock "cinder-quobyte-e415c41e-6257-4ff9-8e36-2b61750b7e86" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:12:45 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1b76f5d9-d245-4201-a726-843e9a6dabbc tempest-VolumesActionsTest-144281045 None] Lock "cinder-quobyte-e415c41e-6257-4ff9-8e36-2b61750b7e86" acquired by "delete_volume" :: waited 0.021s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:12:45 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f67b6f7-b8d8-44da-9248-b8cd01621223]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:12:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1b76f5d9-d245-4201-a726-843e9a6dabbc tempest-VolumesActionsTest-144281045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:45 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-87bbce45-0f74-4ff5-8eca-6b34fb9792ab req-e00bc45a-3c8d-41fa-8593-c9188e08e097 tempest-AttachVolumeNegativeTest-1748370238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-3a967540-94c4-4de5-9499-b9508eb0a5fb" returned: 0 in 0.938s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-87bbce45-0f74-4ff5-8eca-6b34fb9792ab req-e00bc45a-3c8d-41fa-8593-c9188e08e097 tempest-AttachVolumeNegativeTest-1748370238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.961s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:12:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.575s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:12:45 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-937183600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=046572c5-1434-4ae5-9d01-6de1cdd2f86a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b96039928714c9b8c189bae3e1da70b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:12:37Z,use_quota=True,user_id='a6222c2687a041d18d5c1bb5ef11d4f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:12:45 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] Creating volume 046572c5-1434-4ae5-9d01-6de1cdd2f86a {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:12:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:12:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:12:45 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:12:45 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:12:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:12:45 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:12:45 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:12:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-046572c5-1434-4ae5-9d01-6de1cdd2f86a 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:45 devstack sudo[101825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-046572c5-1434-4ae5-9d01-6de1cdd2f86a 1073741824 Jun 29 11:12:45 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-87bbce45-0f74-4ff5-8eca-6b34fb9792ab req-e00bc45a-3c8d-41fa-8593-c9188e08e097 tempest-AttachVolumeNegativeTest-1748370238 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3', 'name': 'volume-3a967540-94c4-4de5-9499-b9508eb0a5fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '63ba5057-9820-4cec-82b8-2274d74e313d', 'enforce_multipath': True} {{(pid=93497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 11:12:45 devstack sudo[101824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86 Jun 29 11:12:45 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:45 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-87bbce45-0f74-4ff5-8eca-6b34fb9792ab req-e00bc45a-3c8d-41fa-8593-c9188e08e097 tempest-AttachVolumeNegativeTest-1748370238 None] attachment_update completed successfully. Jun 29 11:12:46 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1b76f5d9-d245-4201-a726-843e9a6dabbc tempest-VolumesActionsTest-144281045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86" returned: 0 in 0.925s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1b76f5d9-d245-4201-a726-843e9a6dabbc tempest-VolumesActionsTest-144281045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:46 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86 Jun 29 11:12:46 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:46 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-046572c5-1434-4ae5-9d01-6de1cdd2f86a 1073741824" returned: 0 in 0.943s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-046572c5-1434-4ae5-9d01-6de1cdd2f86a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:46 devstack sudo[101904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-046572c5-1434-4ae5-9d01-6de1cdd2f86a Jun 29 11:12:46 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:46 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1b76f5d9-d245-4201-a726-843e9a6dabbc tempest-VolumesActionsTest-144281045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e415c41e-6257-4ff9-8e36-2b61750b7e86" returned: 0 in 0.780s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:46 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1b76f5d9-d245-4201-a726-843e9a6dabbc tempest-VolumesActionsTest-144281045 None] Lock "cinder-quobyte-e415c41e-6257-4ff9-8e36-2b61750b7e86" released by "delete_volume" :: held 1.757s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:12:46 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-046572c5-1434-4ae5-9d01-6de1cdd2f86a" returned: 0 in 0.712s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:12:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:12:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-08ffe5f5-3078-4dba-9cb0-a99b0b37b858 tempest-SnapshotsActionsTest-1787185938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.211s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:12:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d4ebbbb-f031-43f9-af03-5fc9278b85ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-046572c5-1434-4ae5-9d01-6de1cdd2f86a', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:12:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03abf050-c09f-4ebe-b115-149bda327fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:12:47 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] Volume volume-046572c5-1434-4ae5-9d01-6de1cdd2f86a (046572c5-1434-4ae5-9d01-6de1cdd2f86a): created successfully Jun 29 11:12:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03abf050-c09f-4ebe-b115-149bda327fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:12:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] Flow 'volume_create_manager' (535297c8-195c-4628-9528-0d9a974f5f0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:12:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-08ffe5f5-3078-4dba-9cb0-a99b0b37b858 tempest-SnapshotsActionsTest-1787185938 None] Creating offline snapshot b01fa131-3899-48da-9de3-020b53d0d872 of volume 7762ed4d-a09f-418c-90ad-0453ded6b1f0 {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:12:47 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-88ccc83d-6fde-4ce9-bae4-616e9c1a2edc tempest-AttachVolumeTestJSON-246387978 None] Created volume successfully. Jun 29 11:12:47 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-1b76f5d9-d245-4201-a726-843e9a6dabbc tempest-VolumesActionsTest-144281045 None] Created reservations ['e552287a-fca7-4bdd-8594-6912b9951d11', '616e3aaa-d744-4552-8c6e-ff11d23a3f5a', '7af59187-43af-4b7d-a337-800ace437c47', '124765e9-5f6d-43d8-80cf-f84e38ca792c'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:12:47 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[de858d06-103e-4992-9974-a2b35d5c6140]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:12:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-08ffe5f5-3078-4dba-9cb0-a99b0b37b858 tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1b76f5d9-d245-4201-a726-843e9a6dabbc tempest-VolumesActionsTest-144281045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:12:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1b76f5d9-d245-4201-a726-843e9a6dabbc tempest-VolumesActionsTest-144281045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:12:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1b76f5d9-d245-4201-a726-843e9a6dabbc tempest-VolumesActionsTest-144281045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:12:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1b76f5d9-d245-4201-a726-843e9a6dabbc tempest-VolumesActionsTest-144281045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:12:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1b76f5d9-d245-4201-a726-843e9a6dabbc tempest-VolumesActionsTest-144281045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:12:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1b76f5d9-d245-4201-a726-843e9a6dabbc tempest-VolumesActionsTest-144281045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:47 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:12:47 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:47 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 Jun 29 11:12:47 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:48 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-08ffe5f5-3078-4dba-9cb0-a99b0b37b858 tempest-SnapshotsActionsTest-1787185938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4" returned: 0 in 1.010s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:48 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-08ffe5f5-3078-4dba-9cb0-a99b0b37b858 tempest-SnapshotsActionsTest-1787185938 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:12:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-08ffe5f5-3078-4dba-9cb0-a99b0b37b858 tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.b01fa131-3899-48da-9de3-020b53d0d872 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:48 devstack sudo[102274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.b01fa131-3899-48da-9de3-020b53d0d872 1G Jun 29 11:12:48 devstack sudo[102274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:48 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1b76f5d9-d245-4201-a726-843e9a6dabbc tempest-VolumesActionsTest-144281045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.951s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:48 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-1b76f5d9-d245-4201-a726-843e9a6dabbc tempest-VolumesActionsTest-144281045 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:12:48 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-1b76f5d9-d245-4201-a726-843e9a6dabbc tempest-VolumesActionsTest-144281045 None] Deleted volume successfully. Jun 29 11:12:48 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1b76f5d9-d245-4201-a726-843e9a6dabbc tempest-VolumesActionsTest-144281045 None] Lock "cinder-e415c41e-6257-4ff9-8e36-2b61750b7e86-delete_volume" released by "delete_volume" :: held 3.164s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:12:49 devstack sudo[102274]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-08ffe5f5-3078-4dba-9cb0-a99b0b37b858 tempest-SnapshotsActionsTest-1787185938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.b01fa131-3899-48da-9de3-020b53d0d872 1G" returned: 0 in 0.955s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-08ffe5f5-3078-4dba-9cb0-a99b0b37b858 tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.b01fa131-3899-48da-9de3-020b53d0d872 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:49 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.b01fa131-3899-48da-9de3-020b53d0d872 Jun 29 11:12:49 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:50 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-08ffe5f5-3078-4dba-9cb0-a99b0b37b858 tempest-SnapshotsActionsTest-1787185938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.b01fa131-3899-48da-9de3-020b53d0d872" returned: 0 in 0.863s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:50 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-08ffe5f5-3078-4dba-9cb0-a99b0b37b858 tempest-SnapshotsActionsTest-1787185938 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.b01fa131-3899-48da-9de3-020b53d0d872 is being set with open permissions: ugo+rw Jun 29 11:12:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-08ffe5f5-3078-4dba-9cb0-a99b0b37b858 tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.b01fa131-3899-48da-9de3-020b53d0d872 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:50 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.b01fa131-3899-48da-9de3-020b53d0d872 Jun 29 11:12:50 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:50 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-08ffe5f5-3078-4dba-9cb0-a99b0b37b858 tempest-SnapshotsActionsTest-1787185938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.b01fa131-3899-48da-9de3-020b53d0d872" returned: 0 in 0.785s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-08ffe5f5-3078-4dba-9cb0-a99b0b37b858 tempest-SnapshotsActionsTest-1787185938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.883s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:12:50 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-08ffe5f5-3078-4dba-9cb0-a99b0b37b858 tempest-SnapshotsActionsTest-1787185938 None] Create snapshot completed successfully Jun 29 11:12:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-5c2e7701-9cf1-488d-ac64-c79a60d191e9 req-99af74e5-4c5c-4104-abcf-ca15fae44d2f tempest-AttachVolumeTestJSON-246387978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:12:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-5c2e7701-9cf1-488d-ac64-c79a60d191e9 req-99af74e5-4c5c-4104-abcf-ca15fae44d2f tempest-AttachVolumeTestJSON-246387978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:12:51 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c3e4d2-1b21-4a7b-9f04-7ef4e5bf7ff7]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:12:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-5c2e7701-9cf1-488d-ac64-c79a60d191e9 req-99af74e5-4c5c-4104-abcf-ca15fae44d2f tempest-AttachVolumeTestJSON-246387978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-046572c5-1434-4ae5-9d01-6de1cdd2f86a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:51 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-046572c5-1434-4ae5-9d01-6de1cdd2f86a Jun 29 11:12:51 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:51 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a61725d1-1009-457c-afe2-48e71db0d314 tempest-SnapshotsActionsTest-1971824292 None] Acquiring lock "cinder-b01fa131-3899-48da-9de3-020b53d0d872-delete_snapshot" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:12:51 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a61725d1-1009-457c-afe2-48e71db0d314 tempest-SnapshotsActionsTest-1971824292 None] Lock "cinder-b01fa131-3899-48da-9de3-020b53d0d872-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:12:51 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a61725d1-1009-457c-afe2-48e71db0d314 tempest-SnapshotsActionsTest-1971824292 None] Acquiring lock "cinder-quobyte-7762ed4d-a09f-418c-90ad-0453ded6b1f0" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:12:51 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a61725d1-1009-457c-afe2-48e71db0d314 tempest-SnapshotsActionsTest-1971824292 None] Lock "cinder-quobyte-7762ed4d-a09f-418c-90ad-0453ded6b1f0" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:12:51 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a61725d1-1009-457c-afe2-48e71db0d314 tempest-SnapshotsActionsTest-1971824292 None] Acquiring lock "cinder-quobyte-b01fa131-3899-48da-9de3-020b53d0d872" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:12:51 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a61725d1-1009-457c-afe2-48e71db0d314 tempest-SnapshotsActionsTest-1971824292 None] Lock "cinder-quobyte-b01fa131-3899-48da-9de3-020b53d0d872" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:12:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-a61725d1-1009-457c-afe2-48e71db0d314 tempest-SnapshotsActionsTest-1971824292 None] Deleting offline snapshot b01fa131-3899-48da-9de3-020b53d0d872 of volume 7762ed4d-a09f-418c-90ad-0453ded6b1f0 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:12:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-a61725d1-1009-457c-afe2-48e71db0d314 tempest-SnapshotsActionsTest-1971824292 None] snapshot_file for this snap is: volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.b01fa131-3899-48da-9de3-020b53d0d872 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:12:51 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fd75f9-7f0b-40f6-b523-327eea5366c0]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:12:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a61725d1-1009-457c-afe2-48e71db0d314 tempest-SnapshotsActionsTest-1971824292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.b01fa131-3899-48da-9de3-020b53d0d872 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:52 devstack sudo[102301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.b01fa131-3899-48da-9de3-020b53d0d872 Jun 29 11:12:52 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:52 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-5c2e7701-9cf1-488d-ac64-c79a60d191e9 req-99af74e5-4c5c-4104-abcf-ca15fae44d2f tempest-AttachVolumeTestJSON-246387978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-046572c5-1434-4ae5-9d01-6de1cdd2f86a" returned: 0 in 1.211s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-5c2e7701-9cf1-488d-ac64-c79a60d191e9 req-99af74e5-4c5c-4104-abcf-ca15fae44d2f tempest-AttachVolumeTestJSON-246387978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.238s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:12:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-5c2e7701-9cf1-488d-ac64-c79a60d191e9 req-99af74e5-4c5c-4104-abcf-ca15fae44d2f tempest-AttachVolumeTestJSON-246387978 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3', 'name': 'volume-046572c5-1434-4ae5-9d01-6de1cdd2f86a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6f9d8f85-2346-4afd-8bb9-17a6c1fb52d0', 'enforce_multipath': True} {{(pid=93497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 11:12:52 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-5c2e7701-9cf1-488d-ac64-c79a60d191e9 req-99af74e5-4c5c-4104-abcf-ca15fae44d2f tempest-AttachVolumeTestJSON-246387978 None] attachment_update completed successfully. Jun 29 11:12:53 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a61725d1-1009-457c-afe2-48e71db0d314 tempest-SnapshotsActionsTest-1971824292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.b01fa131-3899-48da-9de3-020b53d0d872" returned: 0 in 1.194s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-a61725d1-1009-457c-afe2-48e71db0d314 tempest-SnapshotsActionsTest-1971824292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:12:53 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcc5952-da26-4272-b611-e293ff7b503f]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:12:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a61725d1-1009-457c-afe2-48e71db0d314 tempest-SnapshotsActionsTest-1971824292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:53 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 Jun 29 11:12:53 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:54 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a61725d1-1009-457c-afe2-48e71db0d314 tempest-SnapshotsActionsTest-1971824292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4" returned: 0 in 1.093s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-a61725d1-1009-457c-afe2-48e71db0d314 tempest-SnapshotsActionsTest-1971824292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:12:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a61725d1-1009-457c-afe2-48e71db0d314 tempest-SnapshotsActionsTest-1971824292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.b01fa131-3899-48da-9de3-020b53d0d872 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:54 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.b01fa131-3899-48da-9de3-020b53d0d872 Jun 29 11:12:54 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:55 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a61725d1-1009-457c-afe2-48e71db0d314 tempest-SnapshotsActionsTest-1971824292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.b01fa131-3899-48da-9de3-020b53d0d872" returned: 0 in 0.992s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a61725d1-1009-457c-afe2-48e71db0d314 tempest-SnapshotsActionsTest-1971824292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.b01fa131-3899-48da-9de3-020b53d0d872 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:55 devstack sudo[102326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.b01fa131-3899-48da-9de3-020b53d0d872 Jun 29 11:12:55 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:56 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:12:56 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] Flow 'volume_create_manager' (a01a4b7a-bf7c-48d9-a510-d1ab30045686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:12:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e05909-de04-44e1-809b-64b1ce3b5115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:12:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a61725d1-1009-457c-afe2-48e71db0d314 tempest-SnapshotsActionsTest-1971824292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.b01fa131-3899-48da-9de3-020b53d0d872" returned: 0 in 0.774s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e05909-de04-44e1-809b-64b1ce3b5115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-431859599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6669490c-c720-4596-96a1-45a473c4014e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d4c94402acb4e5bae97ebda6eda45b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:12:56Z,use_quota=True,user_id='6fa33a515e1f4ee582bfaa75521d2e67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:12:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74902037-8534-4ba7-8e41-7d30db1cb97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:12:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74902037-8534-4ba7-8e41-7d30db1cb97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:12:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4744e3b4-e8e2-4647-b1a9-d3fb917c15ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:12:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4744e3b4-e8e2-4647-b1a9-d3fb917c15ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6669490c-c720-4596-96a1-45a473c4014e', 'volume_name': 'volume-6669490c-c720-4596-96a1-45a473c4014e', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:12:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6873fa51-67ef-4aa4-ad12-2f48b2f70049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:12:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6873fa51-67ef-4aa4-ad12-2f48b2f70049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:12:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2906feab-080f-4be7-a664-2fcc4d6059d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:12:56 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] Volume 6669490c-c720-4596-96a1-45a473c4014e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6669490c-c720-4596-96a1-45a473c4014e', 'volume_size': 1} Jun 29 11:12:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:12:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:12:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-431859599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6669490c-c720-4596-96a1-45a473c4014e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d4c94402acb4e5bae97ebda6eda45b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:12:56Z,use_quota=True,user_id='6fa33a515e1f4ee582bfaa75521d2e67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:12:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] Creating volume 6669490c-c720-4596-96a1-45a473c4014e {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:12:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:12:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:12:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:12:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:12:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:12:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:12:56 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:12:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:56 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a61725d1-1009-457c-afe2-48e71db0d314 tempest-SnapshotsActionsTest-1971824292 None] Lock "cinder-quobyte-b01fa131-3899-48da-9de3-020b53d0d872" released by "_delete_snapshot" :: held 4.282s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:12:56 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a61725d1-1009-457c-afe2-48e71db0d314 tempest-SnapshotsActionsTest-1971824292 None] Lock "cinder-quobyte-7762ed4d-a09f-418c-90ad-0453ded6b1f0" released by "delete_snapshot" :: held 4.323s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:12:56 devstack sudo[102329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e 1073741824 Jun 29 11:12:56 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:56 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-a61725d1-1009-457c-afe2-48e71db0d314 tempest-SnapshotsActionsTest-1971824292 None] Created reservations ['55f8c371-8dbe-4057-9628-c45551250f8d', '859aeb04-fe81-45b7-a9eb-2d9902e4df26', '401e19d2-60a0-448f-8aeb-479dfc68f7e8', '3ecaff03-0e13-499b-9550-0767e170c926'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:12:56 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-a61725d1-1009-457c-afe2-48e71db0d314 tempest-SnapshotsActionsTest-1971824292 None] Delete snapshot completed successfully. Jun 29 11:12:56 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a61725d1-1009-457c-afe2-48e71db0d314 tempest-SnapshotsActionsTest-1971824292 None] Lock "cinder-b01fa131-3899-48da-9de3-020b53d0d872-delete_snapshot" released by "delete_snapshot" :: held 4.493s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:12:57 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e 1073741824" returned: 0 in 0.972s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:57 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e Jun 29 11:12:57 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b7d0907f-cd7a-4453-b40b-b5c3606b26ec tempest-SnapshotsActionsTest-1787185938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:12:57 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e" returned: 0 in 0.800s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:57 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:12:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:12:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b7d0907f-cd7a-4453-b40b-b5c3606b26ec tempest-SnapshotsActionsTest-1787185938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.375s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:12:58 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:12:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] Flow 'volume_create_manager' (5fdfa314-2c12-4d02-a02a-6e00d5235a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:12:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d46f3ae4-a32c-4688-a58b-2387bb8a4711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:12:58 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-b7d0907f-cd7a-4453-b40b-b5c3606b26ec tempest-SnapshotsActionsTest-1787185938 None] Creating offline snapshot d4259c04-851c-446c-bbf7-b781d4a56d3c of volume 7762ed4d-a09f-418c-90ad-0453ded6b1f0 {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:12:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2906feab-080f-4be7-a664-2fcc4d6059d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6669490c-c720-4596-96a1-45a473c4014e', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:12:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (625bdd5e-6bab-445c-8944-608efa41765e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:12:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d46f3ae4-a32c-4688-a58b-2387bb8a4711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1256912882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3b85c8-0652-4b46-90fa-36e3c39855cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b96039928714c9b8c189bae3e1da70b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:12:58Z,use_quota=True,user_id='a6222c2687a041d18d5c1bb5ef11d4f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:12:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e916ac32-29a6-4d7f-a1e4-bde5c80c17e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:12:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e916ac32-29a6-4d7f-a1e4-bde5c80c17e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:12:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8904a144-b8e0-4003-9ab5-5273817e1eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:12:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8904a144-b8e0-4003-9ab5-5273817e1eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c3b85c8-0652-4b46-90fa-36e3c39855cb', 'volume_name': 'volume-9c3b85c8-0652-4b46-90fa-36e3c39855cb', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:12:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b62ea06-365f-4199-880a-22198e017a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:12:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b62ea06-365f-4199-880a-22198e017a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:12:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30407595-d8c6-4128-bdaa-5af045876e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:12:58 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] Volume 9c3b85c8-0652-4b46-90fa-36e3c39855cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c3b85c8-0652-4b46-90fa-36e3c39855cb', 'volume_size': 1} Jun 29 11:12:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:12:58 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa77420f-1b90-405f-a570-44883e9b824d]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:12:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b7d0907f-cd7a-4453-b40b-b5c3606b26ec tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:58 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] Volume volume-6669490c-c720-4596-96a1-45a473c4014e (6669490c-c720-4596-96a1-45a473c4014e): created successfully Jun 29 11:12:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (625bdd5e-6bab-445c-8944-608efa41765e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:12:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] Flow 'volume_create_manager' (a01a4b7a-bf7c-48d9-a510-d1ab30045686) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:12:58 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-6c7076e0-dc1f-4564-9db2-8428b5f9fbf9 tempest-VolumesCloneTest-1442208716 None] Created volume successfully. Jun 29 11:12:58 devstack sudo[102354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 Jun 29 11:12:58 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:58 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b7d0907f-cd7a-4453-b40b-b5c3606b26ec tempest-SnapshotsActionsTest-1787185938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4" returned: 0 in 0.762s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:58 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-b7d0907f-cd7a-4453-b40b-b5c3606b26ec tempest-SnapshotsActionsTest-1787185938 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:12:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b7d0907f-cd7a-4453-b40b-b5c3606b26ec tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.d4259c04-851c-446c-bbf7-b781d4a56d3c 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:58 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.d4259c04-851c-446c-bbf7-b781d4a56d3c 1G Jun 29 11:12:58 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:59 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:12:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Flow 'volume_create_manager' (0a5aba7b-7f0c-41bb-9ca5-844c1b7537b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:12:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26be24b6-3389-4e18-9f3a-edfa5a2f068f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:12:59 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Jun 29 11:12:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b7d0907f-cd7a-4453-b40b-b5c3606b26ec tempest-SnapshotsActionsTest-1787185938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.d4259c04-851c-446c-bbf7-b781d4a56d3c 1G" returned: 0 in 1.011s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:12:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b7d0907f-cd7a-4453-b40b-b5c3606b26ec tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.d4259c04-851c-446c-bbf7-b781d4a56d3c {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:12:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26be24b6-3389-4e18-9f3a-edfa5a2f068f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-719036343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d4c94402acb4e5bae97ebda6eda45b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:13:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=6669490c-c720-4596-96a1-45a473c4014e,status='creating',terminated_at=None,updated_at=2026-06-29T09:13:00Z,use_quota=True,user_id='6fa33a515e1f4ee582bfaa75521d2e67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:12:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f435041-2395-46e8-b55f-a307515d018d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:12:59 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.d4259c04-851c-446c-bbf7-b781d4a56d3c Jun 29 11:12:59 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:12:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f435041-2395-46e8-b55f-a307515d018d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:12:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dffe94ee-5d51-4df9-9290-5f1813bc13ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:13:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dffe94ee-5d51-4df9-9290-5f1813bc13ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79', 'volume_name': 'volume-7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79', 'volume_size': 2, 'source_volid': '6669490c-c720-4596-96a1-45a473c4014e', 'source_volstatus': 'available'}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:13:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10a0fe57-9e2a-4bb3-9505-777e2acf4382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:13:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10a0fe57-9e2a-4bb3-9505-777e2acf4382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:13:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d45f4db-6374-45cc-9134-c5ee09cd640c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:13:00 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Volume 7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79', 'volume_size': 2, 'source_volid': '6669490c-c720-4596-96a1-45a473c4014e', 'source_volstatus': 'available'} Jun 29 11:13:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:13:00 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b7d0907f-cd7a-4453-b40b-b5c3606b26ec tempest-SnapshotsActionsTest-1787185938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.d4259c04-851c-446c-bbf7-b781d4a56d3c" returned: 0 in 0.996s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:00 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-b7d0907f-cd7a-4453-b40b-b5c3606b26ec tempest-SnapshotsActionsTest-1787185938 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.d4259c04-851c-446c-bbf7-b781d4a56d3c is being set with open permissions: ugo+rw Jun 29 11:13:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b7d0907f-cd7a-4453-b40b-b5c3606b26ec tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.d4259c04-851c-446c-bbf7-b781d4a56d3c {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:00 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.d4259c04-851c-446c-bbf7-b781d4a56d3c Jun 29 11:13:00 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:01 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b7d0907f-cd7a-4453-b40b-b5c3606b26ec tempest-SnapshotsActionsTest-1787185938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.d4259c04-851c-446c-bbf7-b781d4a56d3c" returned: 0 in 0.788s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b7d0907f-cd7a-4453-b40b-b5c3606b26ec tempest-SnapshotsActionsTest-1787185938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.752s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:13:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.608s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:13:01 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1256912882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3b85c8-0652-4b46-90fa-36e3c39855cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b96039928714c9b8c189bae3e1da70b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:12:58Z,use_quota=True,user_id='a6222c2687a041d18d5c1bb5ef11d4f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:13:01 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] Creating volume 9c3b85c8-0652-4b46-90fa-36e3c39855cb {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:13:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:13:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:13:01 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:13:01 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:13:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:13:01 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:13:01 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:13:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-9c3b85c8-0652-4b46-90fa-36e3c39855cb 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:01 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-9c3b85c8-0652-4b46-90fa-36e3c39855cb 1073741824 Jun 29 11:13:01 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:01 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-b7d0907f-cd7a-4453-b40b-b5c3606b26ec tempest-SnapshotsActionsTest-1787185938 None] Create snapshot completed successfully Jun 29 11:13:02 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-9c3b85c8-0652-4b46-90fa-36e3c39855cb 1073741824" returned: 0 in 1.015s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-9c3b85c8-0652-4b46-90fa-36e3c39855cb {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:02 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-9c3b85c8-0652-4b46-90fa-36e3c39855cb Jun 29 11:13:02 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8c6f57ec-566d-421d-b90a-2cd68a38d92b tempest-SnapshotsActionsTest-1971824292 None] Acquiring lock "cinder-d4259c04-851c-446c-bbf7-b781d4a56d3c-delete_snapshot" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:13:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8c6f57ec-566d-421d-b90a-2cd68a38d92b tempest-SnapshotsActionsTest-1971824292 None] Lock "cinder-d4259c04-851c-446c-bbf7-b781d4a56d3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:13:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8c6f57ec-566d-421d-b90a-2cd68a38d92b tempest-SnapshotsActionsTest-1971824292 None] Acquiring lock "cinder-quobyte-7762ed4d-a09f-418c-90ad-0453ded6b1f0" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:13:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8c6f57ec-566d-421d-b90a-2cd68a38d92b tempest-SnapshotsActionsTest-1971824292 None] Lock "cinder-quobyte-7762ed4d-a09f-418c-90ad-0453ded6b1f0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:13:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8c6f57ec-566d-421d-b90a-2cd68a38d92b tempest-SnapshotsActionsTest-1971824292 None] Acquiring lock "cinder-quobyte-d4259c04-851c-446c-bbf7-b781d4a56d3c" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:13:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8c6f57ec-566d-421d-b90a-2cd68a38d92b tempest-SnapshotsActionsTest-1971824292 None] Lock "cinder-quobyte-d4259c04-851c-446c-bbf7-b781d4a56d3c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:13:03 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-8c6f57ec-566d-421d-b90a-2cd68a38d92b tempest-SnapshotsActionsTest-1971824292 None] Deleting offline snapshot d4259c04-851c-446c-bbf7-b781d4a56d3c of volume 7762ed4d-a09f-418c-90ad-0453ded6b1f0 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:13:03 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-8c6f57ec-566d-421d-b90a-2cd68a38d92b tempest-SnapshotsActionsTest-1971824292 None] snapshot_file for this snap is: volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.d4259c04-851c-446c-bbf7-b781d4a56d3c {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:13:03 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd0129b-97c8-42f0-806c-9aacac247b14]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:13:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8c6f57ec-566d-421d-b90a-2cd68a38d92b tempest-SnapshotsActionsTest-1971824292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.d4259c04-851c-446c-bbf7-b781d4a56d3c {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:03 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.d4259c04-851c-446c-bbf7-b781d4a56d3c Jun 29 11:13:03 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:03 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-9c3b85c8-0652-4b46-90fa-36e3c39855cb" returned: 0 in 0.851s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:03 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:13:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:13:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.634s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:13:03 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Cloning volume 6669490c-c720-4596-96a1-45a473c4014e to volume 7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79 Jun 29 11:13:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30407595-d8c6-4128-bdaa-5af045876e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c3b85c8-0652-4b46-90fa-36e3c39855cb', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:13:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99780b7c-ceaf-404d-af6d-7907d75415f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:13:03 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Creating offline snapshot 590f60cb-bafd-40d4-bda1-ff2b61101b75 of volume 6669490c-c720-4596-96a1-45a473c4014e {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:13:03 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] Volume volume-9c3b85c8-0652-4b46-90fa-36e3c39855cb (9c3b85c8-0652-4b46-90fa-36e3c39855cb): created successfully Jun 29 11:13:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99780b7c-ceaf-404d-af6d-7907d75415f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:13:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] Flow 'volume_create_manager' (5fdfa314-2c12-4d02-a02a-6e00d5235a18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:13:03 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5c1b58-2ebb-4f35-aba2-308387cc36e9]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:13:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:03 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-c90b440f-7724-4238-b515-1c8f31df0154 tempest-AttachVolumeTestJSON-246387978 None] Created volume successfully. Jun 29 11:13:03 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e Jun 29 11:13:03 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:04 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8c6f57ec-566d-421d-b90a-2cd68a38d92b tempest-SnapshotsActionsTest-1971824292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.d4259c04-851c-446c-bbf7-b781d4a56d3c" returned: 0 in 0.941s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:04 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-8c6f57ec-566d-421d-b90a-2cd68a38d92b tempest-SnapshotsActionsTest-1971824292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:13:04 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffc2183-f6d3-4b1a-b583-8f4f09147ff6]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:13:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8c6f57ec-566d-421d-b90a-2cd68a38d92b tempest-SnapshotsActionsTest-1971824292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:04 devstack sudo[102406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 Jun 29 11:13:04 devstack sudo[102406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:04 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e" returned: 0 in 1.043s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e.590f60cb-bafd-40d4-bda1-ff2b61101b75 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:04 devstack sudo[102420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e.590f60cb-bafd-40d4-bda1-ff2b61101b75 1G Jun 29 11:13:04 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:05 devstack sudo[102406]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8c6f57ec-566d-421d-b90a-2cd68a38d92b tempest-SnapshotsActionsTest-1971824292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4" returned: 0 in 1.056s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:05 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-8c6f57ec-566d-421d-b90a-2cd68a38d92b tempest-SnapshotsActionsTest-1971824292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:13:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8c6f57ec-566d-421d-b90a-2cd68a38d92b tempest-SnapshotsActionsTest-1971824292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.d4259c04-851c-446c-bbf7-b781d4a56d3c {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:05 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.d4259c04-851c-446c-bbf7-b781d4a56d3c Jun 29 11:13:05 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:05 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e.590f60cb-bafd-40d4-bda1-ff2b61101b75 1G" returned: 0 in 1.002s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6669490c-c720-4596-96a1-45a473c4014e -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e.590f60cb-bafd-40d4-bda1-ff2b61101b75 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:05 devstack sudo[102437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6669490c-c720-4596-96a1-45a473c4014e -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e.590f60cb-bafd-40d4-bda1-ff2b61101b75 Jun 29 11:13:05 devstack sudo[102437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:06 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8c6f57ec-566d-421d-b90a-2cd68a38d92b tempest-SnapshotsActionsTest-1971824292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.d4259c04-851c-446c-bbf7-b781d4a56d3c" returned: 0 in 0.982s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8c6f57ec-566d-421d-b90a-2cd68a38d92b tempest-SnapshotsActionsTest-1971824292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.d4259c04-851c-446c-bbf7-b781d4a56d3c {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:06 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.d4259c04-851c-446c-bbf7-b781d4a56d3c Jun 29 11:13:06 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:06 devstack sudo[102437]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6669490c-c720-4596-96a1-45a473c4014e -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e.590f60cb-bafd-40d4-bda1-ff2b61101b75" returned: 0 in 0.858s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:06 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e.590f60cb-bafd-40d4-bda1-ff2b61101b75 is being set with open permissions: ugo+rw Jun 29 11:13:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e.590f60cb-bafd-40d4-bda1-ff2b61101b75 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:06 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e.590f60cb-bafd-40d4-bda1-ff2b61101b75 Jun 29 11:13:06 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:06 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8c6f57ec-566d-421d-b90a-2cd68a38d92b tempest-SnapshotsActionsTest-1971824292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.d4259c04-851c-446c-bbf7-b781d4a56d3c" returned: 0 in 0.685s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:07 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8c6f57ec-566d-421d-b90a-2cd68a38d92b tempest-SnapshotsActionsTest-1971824292 None] Lock "cinder-quobyte-d4259c04-851c-446c-bbf7-b781d4a56d3c" released by "_delete_snapshot" :: held 3.816s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:13:07 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8c6f57ec-566d-421d-b90a-2cd68a38d92b tempest-SnapshotsActionsTest-1971824292 None] Lock "cinder-quobyte-7762ed4d-a09f-418c-90ad-0453ded6b1f0" released by "delete_snapshot" :: held 3.848s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:13:07 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-8c6f57ec-566d-421d-b90a-2cd68a38d92b tempest-SnapshotsActionsTest-1971824292 None] Created reservations ['916aaa3b-3003-4d99-8e87-67abdd094b4b', 'bc55ee19-2508-4d31-81e5-b277485e151d', 'd800ca13-269d-4e29-bca7-d578ccfa7e63', '6831289d-aa1a-4d3a-b651-fdbab74a87ba'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:13:07 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-8c6f57ec-566d-421d-b90a-2cd68a38d92b tempest-SnapshotsActionsTest-1971824292 None] Delete snapshot completed successfully. Jun 29 11:13:07 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8c6f57ec-566d-421d-b90a-2cd68a38d92b tempest-SnapshotsActionsTest-1971824292 None] Lock "cinder-d4259c04-851c-446c-bbf7-b781d4a56d3c-delete_snapshot" released by "delete_snapshot" :: held 4.019s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:13:07 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e.590f60cb-bafd-40d4-bda1-ff2b61101b75" returned: 0 in 0.797s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:07 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e.info Jun 29 11:13:07 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-ae5ccb6f-9bca-4d84-b2a2-df48b02c2d8d req-79e42312-0d85-4e6f-9ab0-56f57ed06b5a tempest-AttachVolumeTestJSON-246387978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:13:07 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-be190de4-cd71-4f8c-8285-5135a6e96be9 tempest-SnapshotsActionsTest-1787185938 None] Acquiring lock "cinder-5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4-delete_snapshot" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:13:07 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-be190de4-cd71-4f8c-8285-5135a6e96be9 tempest-SnapshotsActionsTest-1787185938 None] Lock "cinder-5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:13:07 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-be190de4-cd71-4f8c-8285-5135a6e96be9 tempest-SnapshotsActionsTest-1787185938 None] Acquiring lock "cinder-quobyte-7762ed4d-a09f-418c-90ad-0453ded6b1f0" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:13:08 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:13:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:13:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:13:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:13:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:13:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:13:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:08 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-be190de4-cd71-4f8c-8285-5135a6e96be9 tempest-SnapshotsActionsTest-1787185938 None] Lock "cinder-quobyte-7762ed4d-a09f-418c-90ad-0453ded6b1f0" acquired by "delete_snapshot" :: waited 0.040s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:13:08 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-be190de4-cd71-4f8c-8285-5135a6e96be9 tempest-SnapshotsActionsTest-1787185938 None] Acquiring lock "cinder-quobyte-5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:13:08 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-be190de4-cd71-4f8c-8285-5135a6e96be9 tempest-SnapshotsActionsTest-1787185938 None] Lock "cinder-quobyte-5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:13:08 devstack sudo[102502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:13:08 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-be190de4-cd71-4f8c-8285-5135a6e96be9 tempest-SnapshotsActionsTest-1787185938 None] Deleting offline snapshot 5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 of volume 7762ed4d-a09f-418c-90ad-0453ded6b1f0 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:13:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-be190de4-cd71-4f8c-8285-5135a6e96be9 tempest-SnapshotsActionsTest-1787185938 None] snapshot_file for this snap is: volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:13:08 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d2207d-12b1-4850-a543-03277764930b]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:13:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-be190de4-cd71-4f8c-8285-5135a6e96be9 tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:08 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 Jun 29 11:13:08 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:08 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e.info" returned: 0 in 0.852s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:08 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e.info is being set with open permissions: ugo+rw Jun 29 11:13:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:08 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e.info Jun 29 11:13:08 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:09 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.314s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:09 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:13:09 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager._thread_info {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:13:09 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread count: 28 {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 11:13:09 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread info: [<_MainThread(MainThread, started 131117520400512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 11:13:09 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-be190de4-cd71-4f8c-8285-5135a6e96be9 tempest-SnapshotsActionsTest-1787185938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4" returned: 0 in 1.452s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:09 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-be190de4-cd71-4f8c-8285-5135a6e96be9 tempest-SnapshotsActionsTest-1787185938 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:13:09 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3da5a8-a567-424f-9a3b-9d77af80c459]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:13:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-be190de4-cd71-4f8c-8285-5135a6e96be9 tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:09 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e.info" returned: 0 in 1.287s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Acquiring lock "cinder-quobyte-7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79" by "_copy_volume_from_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:13:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Lock "cinder-quobyte-7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:13:09 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] snapshot: 590f60cb-bafd-40d4-bda1-ff2b61101b75, volume: 7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79, {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 11:13:09 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0 Jun 29 11:13:09 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:13:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:13:09 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:13:09 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:13:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:13:09 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b2a8de-34d6-444a-8d3d-cf40dc1a6599]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:13:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e.590f60cb-bafd-40d4-bda1-ff2b61101b75 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:09 devstack sudo[102555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e.590f60cb-bafd-40d4-bda1-ff2b61101b75 Jun 29 11:13:09 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:10 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-be190de4-cd71-4f8c-8285-5135a6e96be9 tempest-SnapshotsActionsTest-1787185938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0" returned: 0 in 0.866s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-be190de4-cd71-4f8c-8285-5135a6e96be9 tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:10 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 Jun 29 11:13:10 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:10 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e.590f60cb-bafd-40d4-bda1-ff2b61101b75" returned: 0 in 1.072s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:10 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6669490c-c720-4596-96a1-45a473c4014e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:13:10 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 11:13:10 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Creating direct copy from snapshot {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 11:13:10 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4cf2ba-b2ab-4fb3-9b76-e01633bd1303]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:13:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:11 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e Jun 29 11:13:11 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:11 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-be190de4-cd71-4f8c-8285-5135a6e96be9 tempest-SnapshotsActionsTest-1787185938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4" returned: 0 in 0.926s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-be190de4-cd71-4f8c-8285-5135a6e96be9 tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:11 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4 Jun 29 11:13:11 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:11 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e" returned: 0 in 1.091s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:11 devstack cinder-volume[93497]: DEBUG cinder.utils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Path /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79 not found in is_blk_device check {{(pid=93497) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 11:13:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:12 devstack sudo[102577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79 Jun 29 11:13:12 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:12 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-be190de4-cd71-4f8c-8285-5135a6e96be9 tempest-SnapshotsActionsTest-1787185938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0.5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4" returned: 0 in 0.807s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:12 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-be190de4-cd71-4f8c-8285-5135a6e96be9 tempest-SnapshotsActionsTest-1787185938 None] Lock "cinder-quobyte-5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4" released by "_delete_snapshot" :: held 4.257s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:13:12 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-be190de4-cd71-4f8c-8285-5135a6e96be9 tempest-SnapshotsActionsTest-1787185938 None] Lock "cinder-quobyte-7762ed4d-a09f-418c-90ad-0453ded6b1f0" released by "delete_snapshot" :: held 4.297s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:13:12 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-be190de4-cd71-4f8c-8285-5135a6e96be9 tempest-SnapshotsActionsTest-1787185938 None] Created reservations ['a439faa9-d1a3-4bcd-bf3e-e085fb4a4f6f', 'c7a5efab-b0f6-44a5-867b-531ba6cf107f', '70ccf4af-1758-4793-80bc-3519ad90dbf7', '9c48d5bf-0d11-4dd2-b5ce-5dd96ba875d5'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:13:12 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-be190de4-cd71-4f8c-8285-5135a6e96be9 tempest-SnapshotsActionsTest-1787185938 None] Delete snapshot completed successfully. Jun 29 11:13:12 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-be190de4-cd71-4f8c-8285-5135a6e96be9 tempest-SnapshotsActionsTest-1787185938 None] Lock "cinder-5e7d8fae-ff06-4c79-a4d1-46fa14fe32a4-delete_snapshot" released by "delete_snapshot" :: held 4.542s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:13:14 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e7c50eab-0ce3-4a8f-9a8c-036cfa210672 tempest-SnapshotsActionsTest-1787185938 None] Acquiring lock "cinder-7762ed4d-a09f-418c-90ad-0453ded6b1f0-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:13:14 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e7c50eab-0ce3-4a8f-9a8c-036cfa210672 tempest-SnapshotsActionsTest-1787185938 None] Lock "cinder-7762ed4d-a09f-418c-90ad-0453ded6b1f0-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:13:14 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e7c50eab-0ce3-4a8f-9a8c-036cfa210672 tempest-SnapshotsActionsTest-1787185938 None] Acquiring lock "cinder-quobyte-7762ed4d-a09f-418c-90ad-0453ded6b1f0" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:13:14 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e7c50eab-0ce3-4a8f-9a8c-036cfa210672 tempest-SnapshotsActionsTest-1787185938 None] Lock "cinder-quobyte-7762ed4d-a09f-418c-90ad-0453ded6b1f0" acquired by "delete_volume" :: waited 0.061s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:13:14 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1ecc2f-7f1b-485c-9bd4-cc0d7f1903db]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:13:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e7c50eab-0ce3-4a8f-9a8c-036cfa210672 tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:15 devstack sudo[102592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0 Jun 29 11:13:15 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:17 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e7c50eab-0ce3-4a8f-9a8c-036cfa210672 tempest-SnapshotsActionsTest-1787185938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0" returned: 0 in 2.954s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e7c50eab-0ce3-4a8f-9a8c-036cfa210672 tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:17 devstack sudo[102606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0 Jun 29 11:13:17 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:20 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79" returned: 0 in 8.052s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:20 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[79773f10-c772-4ac4-8131-f9eb6754bd33]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:13:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:20 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e7c50eab-0ce3-4a8f-9a8c-036cfa210672 tempest-SnapshotsActionsTest-1787185938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7762ed4d-a09f-418c-90ad-0453ded6b1f0" returned: 0 in 2.282s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:20 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e7c50eab-0ce3-4a8f-9a8c-036cfa210672 tempest-SnapshotsActionsTest-1787185938 None] Lock "cinder-quobyte-7762ed4d-a09f-418c-90ad-0453ded6b1f0" released by "delete_volume" :: held 5.428s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:13:20 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-e7c50eab-0ce3-4a8f-9a8c-036cfa210672 tempest-SnapshotsActionsTest-1787185938 None] Created reservations ['8525c0f4-0303-4356-8c23-e5aa603d27b7', 'fecc106f-8e79-4941-8d08-a0336280264a', '59159e4c-2067-422d-aa72-da5884c878ca', '054fdcd1-c534-4e48-9c26-56c84448a112'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:13:20 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e Jun 29 11:13:20 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e7c50eab-0ce3-4a8f-9a8c-036cfa210672 tempest-SnapshotsActionsTest-1787185938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:13:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e7c50eab-0ce3-4a8f-9a8c-036cfa210672 tempest-SnapshotsActionsTest-1787185938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:13:20 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-e7c50eab-0ce3-4a8f-9a8c-036cfa210672 tempest-SnapshotsActionsTest-1787185938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:13:20 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-e7c50eab-0ce3-4a8f-9a8c-036cfa210672 tempest-SnapshotsActionsTest-1787185938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:13:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e7c50eab-0ce3-4a8f-9a8c-036cfa210672 tempest-SnapshotsActionsTest-1787185938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:13:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e7c50eab-0ce3-4a8f-9a8c-036cfa210672 tempest-SnapshotsActionsTest-1787185938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:20 devstack sudo[102611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:13:20 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:21 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e7c50eab-0ce3-4a8f-9a8c-036cfa210672 tempest-SnapshotsActionsTest-1787185938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.809s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:21 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-e7c50eab-0ce3-4a8f-9a8c-036cfa210672 tempest-SnapshotsActionsTest-1787185938 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:13:21 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-e7c50eab-0ce3-4a8f-9a8c-036cfa210672 tempest-SnapshotsActionsTest-1787185938 None] Deleted volume successfully. Jun 29 11:13:21 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e7c50eab-0ce3-4a8f-9a8c-036cfa210672 tempest-SnapshotsActionsTest-1787185938 None] Lock "cinder-7762ed4d-a09f-418c-90ad-0453ded6b1f0-delete_volume" released by "delete_volume" :: held 6.709s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:13:21 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e" returned: 0 in 1.350s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:21 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Image conversion details: src /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e, size 1024.00 MB, duration 8.05 sec, destination /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79 {{(pid=93497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 11:13:21 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Converted 1024.00 MB image at 127.16 MB/s Jun 29 11:13:21 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79 is being set with open permissions: ugo+rw Jun 29 11:13:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:21 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79 Jun 29 11:13:21 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:22 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79" returned: 0 in 0.838s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:22 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Lock "cinder-quobyte-7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79" released by "_copy_volume_from_snapshot" :: held 12.520s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:13:22 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Acquiring lock "cinder-quobyte-590f60cb-bafd-40d4-bda1-ff2b61101b75" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:13:22 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Lock "cinder-quobyte-590f60cb-bafd-40d4-bda1-ff2b61101b75" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:13:22 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Deleting offline snapshot 590f60cb-bafd-40d4-bda1-ff2b61101b75 of volume 6669490c-c720-4596-96a1-45a473c4014e {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:13:22 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] snapshot_file for this snap is: volume-6669490c-c720-4596-96a1-45a473c4014e.590f60cb-bafd-40d4-bda1-ff2b61101b75 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:13:22 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ef2eee-8abe-446f-97fd-6eafb68fea91]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:13:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e.590f60cb-bafd-40d4-bda1-ff2b61101b75 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:22 devstack sudo[102621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e.590f60cb-bafd-40d4-bda1-ff2b61101b75 Jun 29 11:13:22 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:23 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e.590f60cb-bafd-40d4-bda1-ff2b61101b75" returned: 0 in 1.078s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:23 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6669490c-c720-4596-96a1-45a473c4014e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:13:23 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[70141279-8373-4dec-80b0-6e37f7e6c559]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:13:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:23 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e Jun 29 11:13:23 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:24 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e" returned: 0 in 1.003s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e.590f60cb-bafd-40d4-bda1-ff2b61101b75 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:24 devstack sudo[102650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e.590f60cb-bafd-40d4-bda1-ff2b61101b75 Jun 29 11:13:24 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:25 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e.590f60cb-bafd-40d4-bda1-ff2b61101b75" returned: 0 in 0.837s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e.590f60cb-bafd-40d4-bda1-ff2b61101b75 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:25 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e.590f60cb-bafd-40d4-bda1-ff2b61101b75 Jun 29 11:13:25 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:26 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e.590f60cb-bafd-40d4-bda1-ff2b61101b75" returned: 0 in 0.706s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:26 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Lock "cinder-quobyte-590f60cb-bafd-40d4-bda1-ff2b61101b75" released by "_delete_snapshot" :: held 3.785s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:13:26 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=66,cinder:UPDATE=59,cinder:DELETE=6,cinder:INSERT=15 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:13:26 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=58,cinder:UPDATE=59,cinder:INSERT=15,cinder:DELETE=3 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:13:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.440s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:13:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-ae5ccb6f-9bca-4d84-b2a2-df48b02c2d8d req-79e42312-0d85-4e6f-9ab0-56f57ed06b5a tempest-AttachVolumeTestJSON-246387978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 18.457s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:13:26 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d45f4db-6374-45cc-9134-c5ee09cd640c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79', 'volume_size': 2, 'source_volid': '6669490c-c720-4596-96a1-45a473c4014e', 'source_volstatus': 'available'}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:13:26 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2750dc36-fc97-42f7-8857-35dc8ca5e948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:13:26 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[545390cf-1ed6-4093-8fcd-54da231c0472]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:13:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-ae5ccb6f-9bca-4d84-b2a2-df48b02c2d8d req-79e42312-0d85-4e6f-9ab0-56f57ed06b5a tempest-AttachVolumeTestJSON-246387978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-9c3b85c8-0652-4b46-90fa-36e3c39855cb {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:26 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Volume volume-7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79 (7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79): created successfully Jun 29 11:13:26 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2750dc36-fc97-42f7-8857-35dc8ca5e948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:13:26 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Flow 'volume_create_manager' (0a5aba7b-7f0c-41bb-9ca5-844c1b7537b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:13:26 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-a25585d6-294c-45c4-8467-aa04f45d114a tempest-VolumesCloneTest-1442208716 None] Created volume successfully. Jun 29 11:13:26 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-9c3b85c8-0652-4b46-90fa-36e3c39855cb Jun 29 11:13:26 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:27 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-ae5ccb6f-9bca-4d84-b2a2-df48b02c2d8d req-79e42312-0d85-4e6f-9ab0-56f57ed06b5a tempest-AttachVolumeTestJSON-246387978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-9c3b85c8-0652-4b46-90fa-36e3c39855cb" returned: 0 in 0.947s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-ae5ccb6f-9bca-4d84-b2a2-df48b02c2d8d req-79e42312-0d85-4e6f-9ab0-56f57ed06b5a tempest-AttachVolumeTestJSON-246387978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.980s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:13:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3008aa52-e5f1-4933-8a6e-1a98af381809 tempest-VolumesCloneTest-1442208716 None] Acquiring lock "cinder-7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:13:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3008aa52-e5f1-4933-8a6e-1a98af381809 tempest-VolumesCloneTest-1442208716 None] Lock "cinder-7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:13:27 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-ae5ccb6f-9bca-4d84-b2a2-df48b02c2d8d req-79e42312-0d85-4e6f-9ab0-56f57ed06b5a tempest-AttachVolumeTestJSON-246387978 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3', 'name': 'volume-9c3b85c8-0652-4b46-90fa-36e3c39855cb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '840a8d0c-b9b7-400b-816f-9fbb64b254da', 'enforce_multipath': True} {{(pid=93497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 11:13:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3008aa52-e5f1-4933-8a6e-1a98af381809 tempest-VolumesCloneTest-1442208716 None] Acquiring lock "cinder-quobyte-7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:13:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3008aa52-e5f1-4933-8a6e-1a98af381809 tempest-VolumesCloneTest-1442208716 None] Lock "cinder-quobyte-7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79" acquired by "delete_volume" :: waited 0.030s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:13:27 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6364a2a8-55d3-42c4-822f-dfbfe41e5312]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:13:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3008aa52-e5f1-4933-8a6e-1a98af381809 tempest-VolumesCloneTest-1442208716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:27 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-ae5ccb6f-9bca-4d84-b2a2-df48b02c2d8d req-79e42312-0d85-4e6f-9ab0-56f57ed06b5a tempest-AttachVolumeTestJSON-246387978 None] attachment_update completed successfully. Jun 29 11:13:27 devstack sudo[102665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79 Jun 29 11:13:27 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:28 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3008aa52-e5f1-4933-8a6e-1a98af381809 tempest-VolumesCloneTest-1442208716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79" returned: 0 in 1.090s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3008aa52-e5f1-4933-8a6e-1a98af381809 tempest-VolumesCloneTest-1442208716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:28 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79 Jun 29 11:13:28 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:29 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3008aa52-e5f1-4933-8a6e-1a98af381809 tempest-VolumesCloneTest-1442208716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79" returned: 0 in 0.886s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:29 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3008aa52-e5f1-4933-8a6e-1a98af381809 tempest-VolumesCloneTest-1442208716 None] Lock "cinder-quobyte-7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79" released by "delete_volume" :: held 2.042s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:13:29 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-3008aa52-e5f1-4933-8a6e-1a98af381809 tempest-VolumesCloneTest-1442208716 None] Created reservations ['83a7ab7b-0a48-40c6-8e97-9de0b3fea6bc', '7445116c-2968-4856-af40-92fbb3cac0a2', 'd9478541-8a1c-4ad7-8616-d7dc392aebc4', '5014052c-47d9-40b1-ac90-2a8116199e91'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:13:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3008aa52-e5f1-4933-8a6e-1a98af381809 tempest-VolumesCloneTest-1442208716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:13:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3008aa52-e5f1-4933-8a6e-1a98af381809 tempest-VolumesCloneTest-1442208716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:13:29 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-3008aa52-e5f1-4933-8a6e-1a98af381809 tempest-VolumesCloneTest-1442208716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:13:29 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-3008aa52-e5f1-4933-8a6e-1a98af381809 tempest-VolumesCloneTest-1442208716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:13:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3008aa52-e5f1-4933-8a6e-1a98af381809 tempest-VolumesCloneTest-1442208716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:13:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3008aa52-e5f1-4933-8a6e-1a98af381809 tempest-VolumesCloneTest-1442208716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:29 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:13:29 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:30 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3008aa52-e5f1-4933-8a6e-1a98af381809 tempest-VolumesCloneTest-1442208716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.831s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:30 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-3008aa52-e5f1-4933-8a6e-1a98af381809 tempest-VolumesCloneTest-1442208716 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:13:30 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-3008aa52-e5f1-4933-8a6e-1a98af381809 tempest-VolumesCloneTest-1442208716 None] Deleted volume successfully. Jun 29 11:13:30 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3008aa52-e5f1-4933-8a6e-1a98af381809 tempest-VolumesCloneTest-1442208716 None] Lock "cinder-7997d0ce-06d4-4b2c-b48a-d2b3acb0cc79-delete_volume" released by "delete_volume" :: held 3.234s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:13:30 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0c415f65-5892-45df-a88e-58ecadcc1295 tempest-VolumesCloneTest-1442208716 None] Acquiring lock "cinder-6669490c-c720-4596-96a1-45a473c4014e-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:13:30 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0c415f65-5892-45df-a88e-58ecadcc1295 tempest-VolumesCloneTest-1442208716 None] Lock "cinder-6669490c-c720-4596-96a1-45a473c4014e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:13:30 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0c415f65-5892-45df-a88e-58ecadcc1295 tempest-VolumesCloneTest-1442208716 None] Acquiring lock "cinder-quobyte-6669490c-c720-4596-96a1-45a473c4014e" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:13:30 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0c415f65-5892-45df-a88e-58ecadcc1295 tempest-VolumesCloneTest-1442208716 None] Lock "cinder-quobyte-6669490c-c720-4596-96a1-45a473c4014e" acquired by "delete_volume" :: waited 0.037s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:13:30 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb19c1fe-11cd-4034-a9aa-c10be8a0bd0f]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:13:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0c415f65-5892-45df-a88e-58ecadcc1295 tempest-VolumesCloneTest-1442208716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:30 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e Jun 29 11:13:30 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:31 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0c415f65-5892-45df-a88e-58ecadcc1295 tempest-VolumesCloneTest-1442208716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e" returned: 0 in 0.866s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0c415f65-5892-45df-a88e-58ecadcc1295 tempest-VolumesCloneTest-1442208716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:31 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e Jun 29 11:13:31 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:32 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0c415f65-5892-45df-a88e-58ecadcc1295 tempest-VolumesCloneTest-1442208716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6669490c-c720-4596-96a1-45a473c4014e" returned: 0 in 0.806s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:32 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0c415f65-5892-45df-a88e-58ecadcc1295 tempest-VolumesCloneTest-1442208716 None] Lock "cinder-quobyte-6669490c-c720-4596-96a1-45a473c4014e" released by "delete_volume" :: held 1.751s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:13:32 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-0c415f65-5892-45df-a88e-58ecadcc1295 tempest-VolumesCloneTest-1442208716 None] Created reservations ['36c5be26-dd61-4d72-a716-e66eca88a8ff', '2e2e0a38-b1a1-4816-86a5-2a68d01b01bf', '44ea63e0-2756-4c35-8bbf-78d93c5d1e72', 'd39aca79-6f46-49c0-82d9-c66b459b4409'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:13:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0c415f65-5892-45df-a88e-58ecadcc1295 tempest-VolumesCloneTest-1442208716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:13:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0c415f65-5892-45df-a88e-58ecadcc1295 tempest-VolumesCloneTest-1442208716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:13:32 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0c415f65-5892-45df-a88e-58ecadcc1295 tempest-VolumesCloneTest-1442208716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:13:32 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0c415f65-5892-45df-a88e-58ecadcc1295 tempest-VolumesCloneTest-1442208716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:13:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0c415f65-5892-45df-a88e-58ecadcc1295 tempest-VolumesCloneTest-1442208716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:13:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0c415f65-5892-45df-a88e-58ecadcc1295 tempest-VolumesCloneTest-1442208716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:32 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:13:32 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:33 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0c415f65-5892-45df-a88e-58ecadcc1295 tempest-VolumesCloneTest-1442208716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.804s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:33 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-0c415f65-5892-45df-a88e-58ecadcc1295 tempest-VolumesCloneTest-1442208716 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:13:33 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-0c415f65-5892-45df-a88e-58ecadcc1295 tempest-VolumesCloneTest-1442208716 None] Deleted volume successfully. Jun 29 11:13:33 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0c415f65-5892-45df-a88e-58ecadcc1295 tempest-VolumesCloneTest-1442208716 None] Lock "cinder-6669490c-c720-4596-96a1-45a473c4014e-delete_volume" released by "delete_volume" :: held 2.825s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:13:34 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:13:34 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Flow 'volume_create_manager' (165b08aa-fb62-4eb1-ad67-c17ad2f5de7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:13:34 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3da99bd-ccc8-4cb1-be1b-55dd28a40d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:13:34 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3da99bd-ccc8-4cb1-be1b-55dd28a40d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-778393670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=771445fb-c03e-4bff-b799-b1b9a7f48142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c0d038eb4684763949490dd3b405d73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:13:34Z,use_quota=True,user_id='d8f19cf4cbba46a5a62ade1a2f8ed079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34f3a024-efa3-4686-b10e-d2887b01434e),volume_type_id=34f3a024-efa3-4686-b10e-d2887b01434e)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:13:34 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (064a819b-c5fd-4baa-b003-0efada3b78d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:13:34 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (064a819b-c5fd-4baa-b003-0efada3b78d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:13:34 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb6056fc-d5d1-442e-9523-a98d5d5f543d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:13:34 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb6056fc-d5d1-442e-9523-a98d5d5f543d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '771445fb-c03e-4bff-b799-b1b9a7f48142', 'volume_name': 'volume-771445fb-c03e-4bff-b799-b1b9a7f48142', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:13:34 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87b6ac3c-b018-47f1-a992-f55340cae50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:13:34 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87b6ac3c-b018-47f1-a992-f55340cae50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:13:34 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a3a1bb4-35ee-488d-8480-296c745508ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:13:34 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Volume 771445fb-c03e-4bff-b799-b1b9a7f48142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-771445fb-c03e-4bff-b799-b1b9a7f48142', 'volume_size': 1} Jun 29 11:13:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:13:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:13:34 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-778393670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=771445fb-c03e-4bff-b799-b1b9a7f48142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c0d038eb4684763949490dd3b405d73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:13:34Z,use_quota=True,user_id='d8f19cf4cbba46a5a62ade1a2f8ed079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34f3a024-efa3-4686-b10e-d2887b01434e),volume_type_id=34f3a024-efa3-4686-b10e-d2887b01434e)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:13:34 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Creating volume 771445fb-c03e-4bff-b799-b1b9a7f48142 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:13:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:13:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:13:34 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:13:34 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:13:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:13:34 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:13:34 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:13:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-771445fb-c03e-4bff-b799-b1b9a7f48142 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:34 devstack sudo[102700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-771445fb-c03e-4bff-b799-b1b9a7f48142 1073741824 Jun 29 11:13:34 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:35 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-a5e16510-d0e9-40c4-bc06-98e17a5ca605 req-daeef053-018c-431e-aaf3-04312de67ab7 tempest-AttachVolumeTestJSON-246387978 None] Terminate volume connection completed successfully. Jun 29 11:13:35 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-a5e16510-d0e9-40c4-bc06-98e17a5ca605 req-daeef053-018c-431e-aaf3-04312de67ab7 tempest-AttachVolumeTestJSON-246387978 None] Deleting attachment 6f9d8f85-2346-4afd-8bb9-17a6c1fb52d0. {{(pid=93497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 11:13:35 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-771445fb-c03e-4bff-b799-b1b9a7f48142 1073741824" returned: 0 in 1.021s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-771445fb-c03e-4bff-b799-b1b9a7f48142 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:35 devstack sudo[102711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-771445fb-c03e-4bff-b799-b1b9a7f48142 Jun 29 11:13:35 devstack sudo[102711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:36 devstack sudo[102711]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-771445fb-c03e-4bff-b799-b1b9a7f48142" returned: 0 in 1.040s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:36 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] <== create_volume: return (2112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:13:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.114s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:13:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a3a1bb4-35ee-488d-8480-296c745508ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-771445fb-c03e-4bff-b799-b1b9a7f48142', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:13:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e80f660e-fb43-4e47-99c0-a918afe16dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:13:36 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Volume volume-771445fb-c03e-4bff-b799-b1b9a7f48142 (771445fb-c03e-4bff-b799-b1b9a7f48142): created successfully Jun 29 11:13:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e80f660e-fb43-4e47-99c0-a918afe16dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:13:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Flow 'volume_create_manager' (165b08aa-fb62-4eb1-ad67-c17ad2f5de7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:13:36 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-58d82fbc-8fd4-4e6c-9036-ab90a77911d1 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Created volume successfully. Jun 29 11:13:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-07b6862e-b97e-4189-a366-ecb68e5322a3 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:13:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-07b6862e-b97e-4189-a366-ecb68e5322a3 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:13:38 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-07b6862e-b97e-4189-a366-ecb68e5322a3 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:13:38 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-07b6862e-b97e-4189-a366-ecb68e5322a3 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:13:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-07b6862e-b97e-4189-a366-ecb68e5322a3 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:13:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-07b6862e-b97e-4189-a366-ecb68e5322a3 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:38 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:13:38 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:38 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-8400709f-f07b-4663-9939-3eceefe43a95 req-81858d5d-09ae-4774-a180-37a09f21808b tempest-AttachVolumeTestJSON-246387978 None] Terminate volume connection completed successfully. Jun 29 11:13:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-8400709f-f07b-4663-9939-3eceefe43a95 req-81858d5d-09ae-4774-a180-37a09f21808b tempest-AttachVolumeTestJSON-246387978 None] Deleting attachment 840a8d0c-b9b7-400b-816f-9fbb64b254da. {{(pid=93497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 11:13:39 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-07b6862e-b97e-4189-a366-ecb68e5322a3 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.960s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:39 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-07b6862e-b97e-4189-a366-ecb68e5322a3 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:13:39 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-07b6862e-b97e-4189-a366-ecb68e5322a3 tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Retype volume completed successfully. Jun 29 11:13:39 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-750a8890-82e7-432a-bcd6-4d692dbf331d tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Acquiring lock "cinder-771445fb-c03e-4bff-b799-b1b9a7f48142-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:13:39 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-750a8890-82e7-432a-bcd6-4d692dbf331d tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Lock "cinder-771445fb-c03e-4bff-b799-b1b9a7f48142-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:13:39 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-750a8890-82e7-432a-bcd6-4d692dbf331d tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Acquiring lock "cinder-quobyte-771445fb-c03e-4bff-b799-b1b9a7f48142" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:13:39 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-750a8890-82e7-432a-bcd6-4d692dbf331d tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Lock "cinder-quobyte-771445fb-c03e-4bff-b799-b1b9a7f48142" acquired by "delete_volume" :: waited 0.017s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:13:39 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c172862-6c1c-4a8c-acb9-0ca1c4db1ef4]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:13:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-750a8890-82e7-432a-bcd6-4d692dbf331d tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-771445fb-c03e-4bff-b799-b1b9a7f48142 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:39 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-771445fb-c03e-4bff-b799-b1b9a7f48142 Jun 29 11:13:39 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:40 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-750a8890-82e7-432a-bcd6-4d692dbf331d tempest-VolumeRetypeWithoutMigrationTest-712248692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-771445fb-c03e-4bff-b799-b1b9a7f48142" returned: 0 in 1.090s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-750a8890-82e7-432a-bcd6-4d692dbf331d tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-771445fb-c03e-4bff-b799-b1b9a7f48142 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:40 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-771445fb-c03e-4bff-b799-b1b9a7f48142 Jun 29 11:13:40 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:41 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-750a8890-82e7-432a-bcd6-4d692dbf331d tempest-VolumeRetypeWithoutMigrationTest-712248692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-771445fb-c03e-4bff-b799-b1b9a7f48142" returned: 0 in 0.950s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:41 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-750a8890-82e7-432a-bcd6-4d692dbf331d tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Lock "cinder-quobyte-771445fb-c03e-4bff-b799-b1b9a7f48142" released by "delete_volume" :: held 2.094s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:13:41 devstack cinder-volume[93497]: WARNING cinder.quota [None req-750a8890-82e7-432a-bcd6-4d692dbf331d tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:13:41 devstack cinder-volume[93497]: WARNING cinder.quota [None req-750a8890-82e7-432a-bcd6-4d692dbf331d tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:13:41 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-750a8890-82e7-432a-bcd6-4d692dbf331d tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Created reservations ['f68becff-6f31-416d-b7cb-2df36e8a9ddf', 'd4a41d46-d4ef-41e7-bf06-213e108b0053', '03e27365-618a-408d-b642-cbadde937f59', '510743d0-6a3e-402f-8d1b-58bbceadb5af'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:13:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-750a8890-82e7-432a-bcd6-4d692dbf331d tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:13:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-750a8890-82e7-432a-bcd6-4d692dbf331d tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:13:41 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-750a8890-82e7-432a-bcd6-4d692dbf331d tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:13:41 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-750a8890-82e7-432a-bcd6-4d692dbf331d tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:13:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-750a8890-82e7-432a-bcd6-4d692dbf331d tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:13:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-750a8890-82e7-432a-bcd6-4d692dbf331d tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:41 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:13:41 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:42 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-750a8890-82e7-432a-bcd6-4d692dbf331d tempest-VolumeRetypeWithoutMigrationTest-712248692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.989s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:42 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-750a8890-82e7-432a-bcd6-4d692dbf331d tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:13:42 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-750a8890-82e7-432a-bcd6-4d692dbf331d tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Deleted volume successfully. Jun 29 11:13:42 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-750a8890-82e7-432a-bcd6-4d692dbf331d tempest-VolumeRetypeWithoutMigrationTest-712248692 None] Lock "cinder-771445fb-c03e-4bff-b799-b1b9a7f48142-delete_volume" released by "delete_volume" :: held 3.419s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:13:49 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-4916f556-f467-4ad0-8d73-07bbd217e840 req-57bdc55c-4b54-4d1d-b3e5-b095bd5e283c tempest-AttachVolumeNegativeTest-1748370238 None] Terminate volume connection completed successfully. Jun 29 11:13:49 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-4916f556-f467-4ad0-8d73-07bbd217e840 req-57bdc55c-4b54-4d1d-b3e5-b095bd5e283c tempest-AttachVolumeNegativeTest-1748370238 None] Deleting attachment 63ba5057-9820-4cec-82b8-2274d74e313d. {{(pid=93497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 11:13:50 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-898deea1-9a8a-49a4-8c0f-99bb00a950c8 tempest-AttachVolumeTestJSON-246387978 None] Acquiring lock "cinder-9c3b85c8-0652-4b46-90fa-36e3c39855cb-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:13:50 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-898deea1-9a8a-49a4-8c0f-99bb00a950c8 tempest-AttachVolumeTestJSON-246387978 None] Lock "cinder-9c3b85c8-0652-4b46-90fa-36e3c39855cb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:13:50 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-898deea1-9a8a-49a4-8c0f-99bb00a950c8 tempest-AttachVolumeTestJSON-246387978 None] Acquiring lock "cinder-quobyte-9c3b85c8-0652-4b46-90fa-36e3c39855cb" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:13:51 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-898deea1-9a8a-49a4-8c0f-99bb00a950c8 tempest-AttachVolumeTestJSON-246387978 None] Lock "cinder-quobyte-9c3b85c8-0652-4b46-90fa-36e3c39855cb" acquired by "delete_volume" :: waited 0.015s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:13:51 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a44b5b-2ce8-4f40-87c4-f5cacda86cc9]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:13:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-898deea1-9a8a-49a4-8c0f-99bb00a950c8 tempest-AttachVolumeTestJSON-246387978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-9c3b85c8-0652-4b46-90fa-36e3c39855cb {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:51 devstack sudo[102865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-9c3b85c8-0652-4b46-90fa-36e3c39855cb Jun 29 11:13:51 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:52 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-898deea1-9a8a-49a4-8c0f-99bb00a950c8 tempest-AttachVolumeTestJSON-246387978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-9c3b85c8-0652-4b46-90fa-36e3c39855cb" returned: 0 in 1.096s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-898deea1-9a8a-49a4-8c0f-99bb00a950c8 tempest-AttachVolumeTestJSON-246387978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-9c3b85c8-0652-4b46-90fa-36e3c39855cb {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:52 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-9c3b85c8-0652-4b46-90fa-36e3c39855cb Jun 29 11:13:52 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:52 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:13:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Flow 'volume_create_manager' (944248f0-a8a0-41b0-a005-a2deca4a5ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:13:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (936ea939-f245-4340-961f-ee35a0ccb794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:13:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (936ea939-f245-4340-961f-ee35a0ccb794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1543715654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dc7d2ed-87f4-406f-b106-2121ab731b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c5f1cae57274ca8b4baa4996855548c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:13:52Z,use_quota=True,user_id='4fd38876fa8342b9b01f6403f312ae84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:13:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89ca1389-4ca2-44a2-96d1-c1a455408675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:13:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89ca1389-4ca2-44a2-96d1-c1a455408675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:13:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82091920-378a-4fd2-aa7d-dc9e4405f0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:13:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82091920-378a-4fd2-aa7d-dc9e4405f0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dc7d2ed-87f4-406f-b106-2121ab731b21', 'volume_name': 'volume-1dc7d2ed-87f4-406f-b106-2121ab731b21', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:13:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78fe2c19-9f65-47cd-b322-9dc45772040a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:13:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78fe2c19-9f65-47cd-b322-9dc45772040a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:13:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15bdb258-b5e2-4448-84fc-76bead16d756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:13:52 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Volume 1dc7d2ed-87f4-406f-b106-2121ab731b21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dc7d2ed-87f4-406f-b106-2121ab731b21', 'volume_size': 1} Jun 29 11:13:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:13:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:13:52 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1543715654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dc7d2ed-87f4-406f-b106-2121ab731b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c5f1cae57274ca8b4baa4996855548c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:13:52Z,use_quota=True,user_id='4fd38876fa8342b9b01f6403f312ae84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:13:52 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Creating volume 1dc7d2ed-87f4-406f-b106-2121ab731b21 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:13:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:13:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:13:52 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:13:52 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:13:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:13:52 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:13:52 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:13:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:52 devstack sudo[102872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21 1073741824 Jun 29 11:13:52 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:52 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-898deea1-9a8a-49a4-8c0f-99bb00a950c8 tempest-AttachVolumeTestJSON-246387978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-9c3b85c8-0652-4b46-90fa-36e3c39855cb" returned: 0 in 0.757s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:52 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-898deea1-9a8a-49a4-8c0f-99bb00a950c8 tempest-AttachVolumeTestJSON-246387978 None] Lock "cinder-quobyte-9c3b85c8-0652-4b46-90fa-36e3c39855cb" released by "delete_volume" :: held 1.908s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:13:52 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-898deea1-9a8a-49a4-8c0f-99bb00a950c8 tempest-AttachVolumeTestJSON-246387978 None] Created reservations ['6c38bad8-5ab6-46de-a107-35ff049383bc', 'bf44db8f-c02d-4fe8-9ebb-a953663cf0b8', '50c63eeb-4c77-4c5d-98e2-81e23c17efa7', '4a5ba740-5d32-4dbf-b8bb-201af7bdc674'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:13:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-898deea1-9a8a-49a4-8c0f-99bb00a950c8 tempest-AttachVolumeTestJSON-246387978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:13:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-898deea1-9a8a-49a4-8c0f-99bb00a950c8 tempest-AttachVolumeTestJSON-246387978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:13:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-898deea1-9a8a-49a4-8c0f-99bb00a950c8 tempest-AttachVolumeTestJSON-246387978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:13:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-898deea1-9a8a-49a4-8c0f-99bb00a950c8 tempest-AttachVolumeTestJSON-246387978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:13:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-898deea1-9a8a-49a4-8c0f-99bb00a950c8 tempest-AttachVolumeTestJSON-246387978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:13:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-898deea1-9a8a-49a4-8c0f-99bb00a950c8 tempest-AttachVolumeTestJSON-246387978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:53 devstack sudo[102886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:13:53 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:53 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0c1154ed-2944-486c-9d23-7dd07a91618c tempest-AttachVolumeTestJSON-246387978 None] Acquiring lock "cinder-046572c5-1434-4ae5-9d01-6de1cdd2f86a-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:13:53 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0c1154ed-2944-486c-9d23-7dd07a91618c tempest-AttachVolumeTestJSON-246387978 None] Lock "cinder-046572c5-1434-4ae5-9d01-6de1cdd2f86a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:13:53 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0c1154ed-2944-486c-9d23-7dd07a91618c tempest-AttachVolumeTestJSON-246387978 None] Acquiring lock "cinder-quobyte-046572c5-1434-4ae5-9d01-6de1cdd2f86a" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:13:53 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0c1154ed-2944-486c-9d23-7dd07a91618c tempest-AttachVolumeTestJSON-246387978 None] Lock "cinder-quobyte-046572c5-1434-4ae5-9d01-6de1cdd2f86a" acquired by "delete_volume" :: waited 0.023s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:13:53 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[44abd6dd-20ca-40cf-b555-0050c5930929]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:13:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0c1154ed-2944-486c-9d23-7dd07a91618c tempest-AttachVolumeTestJSON-246387978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-046572c5-1434-4ae5-9d01-6de1cdd2f86a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:53 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21 1073741824" returned: 0 in 1.421s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:53 devstack sudo[102910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-046572c5-1434-4ae5-9d01-6de1cdd2f86a Jun 29 11:13:53 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:53 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21 Jun 29 11:13:53 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:54 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-898deea1-9a8a-49a4-8c0f-99bb00a950c8 tempest-AttachVolumeTestJSON-246387978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.342s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:54 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-898deea1-9a8a-49a4-8c0f-99bb00a950c8 tempest-AttachVolumeTestJSON-246387978 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:13:54 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-898deea1-9a8a-49a4-8c0f-99bb00a950c8 tempest-AttachVolumeTestJSON-246387978 None] Deleted volume successfully. Jun 29 11:13:54 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-898deea1-9a8a-49a4-8c0f-99bb00a950c8 tempest-AttachVolumeTestJSON-246387978 None] Lock "cinder-9c3b85c8-0652-4b46-90fa-36e3c39855cb-delete_volume" released by "delete_volume" :: held 3.588s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:13:54 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21" returned: 0 in 0.803s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] <== create_volume: return (2282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:13:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.284s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:13:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15bdb258-b5e2-4448-84fc-76bead16d756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dc7d2ed-87f4-406f-b106-2121ab731b21', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:13:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e0fb21-92ce-424f-9fe2-7021fd8f7405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:13:54 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Volume volume-1dc7d2ed-87f4-406f-b106-2121ab731b21 (1dc7d2ed-87f4-406f-b106-2121ab731b21): created successfully Jun 29 11:13:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e0fb21-92ce-424f-9fe2-7021fd8f7405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:13:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Flow 'volume_create_manager' (944248f0-a8a0-41b0-a005-a2deca4a5ea6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:13:54 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-2e4aec68-dc9f-471a-9e27-40af0284323e tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Created volume successfully. Jun 29 11:13:54 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0c1154ed-2944-486c-9d23-7dd07a91618c tempest-AttachVolumeTestJSON-246387978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-046572c5-1434-4ae5-9d01-6de1cdd2f86a" returned: 0 in 1.278s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0c1154ed-2944-486c-9d23-7dd07a91618c tempest-AttachVolumeTestJSON-246387978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-046572c5-1434-4ae5-9d01-6de1cdd2f86a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:54 devstack sudo[102932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-046572c5-1434-4ae5-9d01-6de1cdd2f86a Jun 29 11:13:54 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:55 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0c1154ed-2944-486c-9d23-7dd07a91618c tempest-AttachVolumeTestJSON-246387978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-046572c5-1434-4ae5-9d01-6de1cdd2f86a" returned: 0 in 0.770s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0c1154ed-2944-486c-9d23-7dd07a91618c tempest-AttachVolumeTestJSON-246387978 None] Lock "cinder-quobyte-046572c5-1434-4ae5-9d01-6de1cdd2f86a" released by "delete_volume" :: held 2.140s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:13:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-45ac0967-c017-4ed8-a32f-04a41291aa08 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:13:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-45ac0967-c017-4ed8-a32f-04a41291aa08 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:13:55 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-45ac0967-c017-4ed8-a32f-04a41291aa08 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Creating offline snapshot 6cb84dcf-0fcb-41f2-b1bc-d58a44a322ed of volume 1dc7d2ed-87f4-406f-b106-2121ab731b21 {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:13:55 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[371dc2ab-f6d4-47ad-9a3d-acebd4c63a77]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:13:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-45ac0967-c017-4ed8-a32f-04a41291aa08 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:55 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-0c1154ed-2944-486c-9d23-7dd07a91618c tempest-AttachVolumeTestJSON-246387978 None] Created reservations ['dd611c99-c051-4fc8-8ba6-4af33a988af0', '0f85ac62-0cc1-427c-bbbf-304436935826', '643f4cf9-77fd-4df0-8a9b-8afa46c25ad0', '058dac9f-c1bd-4c8c-b011-e3bb190b69f1'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:13:55 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21 Jun 29 11:13:55 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0c1154ed-2944-486c-9d23-7dd07a91618c tempest-AttachVolumeTestJSON-246387978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:13:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0c1154ed-2944-486c-9d23-7dd07a91618c tempest-AttachVolumeTestJSON-246387978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:13:55 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0c1154ed-2944-486c-9d23-7dd07a91618c tempest-AttachVolumeTestJSON-246387978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:13:55 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0c1154ed-2944-486c-9d23-7dd07a91618c tempest-AttachVolumeTestJSON-246387978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:13:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0c1154ed-2944-486c-9d23-7dd07a91618c tempest-AttachVolumeTestJSON-246387978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:13:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0c1154ed-2944-486c-9d23-7dd07a91618c tempest-AttachVolumeTestJSON-246387978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:56 devstack sudo[102938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:13:56 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:56 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-45ac0967-c017-4ed8-a32f-04a41291aa08 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21" returned: 0 in 0.888s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-45ac0967-c017-4ed8-a32f-04a41291aa08 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21.6cb84dcf-0fcb-41f2-b1bc-d58a44a322ed 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:56 devstack sudo[102944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21.6cb84dcf-0fcb-41f2-b1bc-d58a44a322ed 1G Jun 29 11:13:56 devstack sudo[102944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:56 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0c1154ed-2944-486c-9d23-7dd07a91618c tempest-AttachVolumeTestJSON-246387978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.807s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:56 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-0c1154ed-2944-486c-9d23-7dd07a91618c tempest-AttachVolumeTestJSON-246387978 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:13:56 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-0c1154ed-2944-486c-9d23-7dd07a91618c tempest-AttachVolumeTestJSON-246387978 None] Deleted volume successfully. Jun 29 11:13:56 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0c1154ed-2944-486c-9d23-7dd07a91618c tempest-AttachVolumeTestJSON-246387978 None] Lock "cinder-046572c5-1434-4ae5-9d01-6de1cdd2f86a-delete_volume" released by "delete_volume" :: held 3.419s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:13:56 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b3981790-cabb-45cf-b73d-74b8c0e77548 tempest-AttachVolumeTestJSON-246387978 None] Acquiring lock "cinder-adc25e7b-bded-4e76-afee-697e786a20ef-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:13:56 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b3981790-cabb-45cf-b73d-74b8c0e77548 tempest-AttachVolumeTestJSON-246387978 None] Lock "cinder-adc25e7b-bded-4e76-afee-697e786a20ef-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:13:57 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b3981790-cabb-45cf-b73d-74b8c0e77548 tempest-AttachVolumeTestJSON-246387978 None] Acquiring lock "cinder-quobyte-adc25e7b-bded-4e76-afee-697e786a20ef" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:13:57 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b3981790-cabb-45cf-b73d-74b8c0e77548 tempest-AttachVolumeTestJSON-246387978 None] Lock "cinder-quobyte-adc25e7b-bded-4e76-afee-697e786a20ef" acquired by "delete_volume" :: waited 0.022s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:13:57 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6221cf0e-6e3c-45b9-9eb7-b228fe502b4c]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:13:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b3981790-cabb-45cf-b73d-74b8c0e77548 tempest-AttachVolumeTestJSON-246387978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-adc25e7b-bded-4e76-afee-697e786a20ef {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:57 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-adc25e7b-bded-4e76-afee-697e786a20ef Jun 29 11:13:57 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:57 devstack sudo[102944]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-45ac0967-c017-4ed8-a32f-04a41291aa08 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21.6cb84dcf-0fcb-41f2-b1bc-d58a44a322ed 1G" returned: 0 in 1.091s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-45ac0967-c017-4ed8-a32f-04a41291aa08 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dc7d2ed-87f4-406f-b106-2121ab731b21 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21.6cb84dcf-0fcb-41f2-b1bc-d58a44a322ed {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:57 devstack sudo[102953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dc7d2ed-87f4-406f-b106-2121ab731b21 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21.6cb84dcf-0fcb-41f2-b1bc-d58a44a322ed Jun 29 11:13:57 devstack sudo[102953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:57 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b3981790-cabb-45cf-b73d-74b8c0e77548 tempest-AttachVolumeTestJSON-246387978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-adc25e7b-bded-4e76-afee-697e786a20ef" returned: 0 in 0.852s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b3981790-cabb-45cf-b73d-74b8c0e77548 tempest-AttachVolumeTestJSON-246387978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-adc25e7b-bded-4e76-afee-697e786a20ef {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:57 devstack sudo[102958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-adc25e7b-bded-4e76-afee-697e786a20ef Jun 29 11:13:57 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:58 devstack sudo[102953]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-45ac0967-c017-4ed8-a32f-04a41291aa08 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dc7d2ed-87f4-406f-b106-2121ab731b21 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21.6cb84dcf-0fcb-41f2-b1bc-d58a44a322ed" returned: 0 in 0.775s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:58 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-45ac0967-c017-4ed8-a32f-04a41291aa08 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21.6cb84dcf-0fcb-41f2-b1bc-d58a44a322ed is being set with open permissions: ugo+rw Jun 29 11:13:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-45ac0967-c017-4ed8-a32f-04a41291aa08 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21.6cb84dcf-0fcb-41f2-b1bc-d58a44a322ed {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:58 devstack sudo[102965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21.6cb84dcf-0fcb-41f2-b1bc-d58a44a322ed Jun 29 11:13:58 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:58 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b3981790-cabb-45cf-b73d-74b8c0e77548 tempest-AttachVolumeTestJSON-246387978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-adc25e7b-bded-4e76-afee-697e786a20ef" returned: 0 in 0.724s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:58 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b3981790-cabb-45cf-b73d-74b8c0e77548 tempest-AttachVolumeTestJSON-246387978 None] Lock "cinder-quobyte-adc25e7b-bded-4e76-afee-697e786a20ef" released by "delete_volume" :: held 1.636s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:13:58 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-b3981790-cabb-45cf-b73d-74b8c0e77548 tempest-AttachVolumeTestJSON-246387978 None] Created reservations ['a0f10cf8-bfcb-4c81-adf0-4dd7193e612d', 'c5ed17ea-4294-4e24-9d50-4baf98c3bf68', 'e9d3bd3d-d761-4729-a26f-12485ca5e8e4', 'df94e276-c262-42dc-9cf5-1634cdc82328'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:13:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b3981790-cabb-45cf-b73d-74b8c0e77548 tempest-AttachVolumeTestJSON-246387978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:13:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b3981790-cabb-45cf-b73d-74b8c0e77548 tempest-AttachVolumeTestJSON-246387978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:13:58 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b3981790-cabb-45cf-b73d-74b8c0e77548 tempest-AttachVolumeTestJSON-246387978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:13:58 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b3981790-cabb-45cf-b73d-74b8c0e77548 tempest-AttachVolumeTestJSON-246387978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:13:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b3981790-cabb-45cf-b73d-74b8c0e77548 tempest-AttachVolumeTestJSON-246387978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:13:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b3981790-cabb-45cf-b73d-74b8c0e77548 tempest-AttachVolumeTestJSON-246387978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:58 devstack sudo[102968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:13:58 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:59 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-45ac0967-c017-4ed8-a32f-04a41291aa08 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21.6cb84dcf-0fcb-41f2-b1bc-d58a44a322ed" returned: 0 in 0.875s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-45ac0967-c017-4ed8-a32f-04a41291aa08 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:13:59 devstack sudo[102972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21.info Jun 29 11:13:59 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:13:59 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root Jun 29 11:13:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b3981790-cabb-45cf-b73d-74b8c0e77548 tempest-AttachVolumeTestJSON-246387978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.994s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:13:59 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-b3981790-cabb-45cf-b73d-74b8c0e77548 tempest-AttachVolumeTestJSON-246387978 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:13:59 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-b3981790-cabb-45cf-b73d-74b8c0e77548 tempest-AttachVolumeTestJSON-246387978 None] Deleted volume successfully. Jun 29 11:13:59 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b3981790-cabb-45cf-b73d-74b8c0e77548 tempest-AttachVolumeTestJSON-246387978 None] Lock "cinder-adc25e7b-bded-4e76-afee-697e786a20ef-delete_volume" released by "delete_volume" :: held 3.020s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:14:00 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-45ac0967-c017-4ed8-a32f-04a41291aa08 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21.info" returned: 0 in 0.819s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:00 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-45ac0967-c017-4ed8-a32f-04a41291aa08 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21.info is being set with open permissions: ugo+rw Jun 29 11:14:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-45ac0967-c017-4ed8-a32f-04a41291aa08 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:00 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21.info Jun 29 11:14:00 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:00 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-45ac0967-c017-4ed8-a32f-04a41291aa08 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21.info" returned: 0 in 0.668s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-45ac0967-c017-4ed8-a32f-04a41291aa08 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.289s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:14:01 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-45ac0967-c017-4ed8-a32f-04a41291aa08 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Create snapshot completed successfully Jun 29 11:14:02 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2fe9a3c4-d9a8-4c71-8f8c-7dc36f9e7df8 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Acquiring lock "cinder-6cb84dcf-0fcb-41f2-b1bc-d58a44a322ed-delete_snapshot" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:14:02 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2fe9a3c4-d9a8-4c71-8f8c-7dc36f9e7df8 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Lock "cinder-6cb84dcf-0fcb-41f2-b1bc-d58a44a322ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:14:02 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2fe9a3c4-d9a8-4c71-8f8c-7dc36f9e7df8 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Acquiring lock "cinder-quobyte-1dc7d2ed-87f4-406f-b106-2121ab731b21" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:14:02 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2fe9a3c4-d9a8-4c71-8f8c-7dc36f9e7df8 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Lock "cinder-quobyte-1dc7d2ed-87f4-406f-b106-2121ab731b21" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:14:02 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2fe9a3c4-d9a8-4c71-8f8c-7dc36f9e7df8 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Acquiring lock "cinder-quobyte-6cb84dcf-0fcb-41f2-b1bc-d58a44a322ed" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:14:02 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2fe9a3c4-d9a8-4c71-8f8c-7dc36f9e7df8 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Lock "cinder-quobyte-6cb84dcf-0fcb-41f2-b1bc-d58a44a322ed" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:14:02 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-2fe9a3c4-d9a8-4c71-8f8c-7dc36f9e7df8 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Deleting offline snapshot 6cb84dcf-0fcb-41f2-b1bc-d58a44a322ed of volume 1dc7d2ed-87f4-406f-b106-2121ab731b21 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:14:02 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-2fe9a3c4-d9a8-4c71-8f8c-7dc36f9e7df8 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] snapshot_file for this snap is: volume-1dc7d2ed-87f4-406f-b106-2121ab731b21.6cb84dcf-0fcb-41f2-b1bc-d58a44a322ed {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:14:02 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[838b13d0-ae3c-4ce2-bdfc-00d6c0fb04af]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:14:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2fe9a3c4-d9a8-4c71-8f8c-7dc36f9e7df8 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21.6cb84dcf-0fcb-41f2-b1bc-d58a44a322ed {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:02 devstack sudo[102980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21.6cb84dcf-0fcb-41f2-b1bc-d58a44a322ed Jun 29 11:14:02 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:03 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2fe9a3c4-d9a8-4c71-8f8c-7dc36f9e7df8 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21.6cb84dcf-0fcb-41f2-b1bc-d58a44a322ed" returned: 0 in 0.905s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:03 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-2fe9a3c4-d9a8-4c71-8f8c-7dc36f9e7df8 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1dc7d2ed-87f4-406f-b106-2121ab731b21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:14:03 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ce0d01-4ca2-4df1-bf97-3a6a43132ec9]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:14:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2fe9a3c4-d9a8-4c71-8f8c-7dc36f9e7df8 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:03 devstack sudo[102985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21 Jun 29 11:14:03 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:04 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2fe9a3c4-d9a8-4c71-8f8c-7dc36f9e7df8 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21" returned: 0 in 0.978s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2fe9a3c4-d9a8-4c71-8f8c-7dc36f9e7df8 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21.6cb84dcf-0fcb-41f2-b1bc-d58a44a322ed {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:04 devstack sudo[102991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21.6cb84dcf-0fcb-41f2-b1bc-d58a44a322ed Jun 29 11:14:04 devstack sudo[102991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:05 devstack sudo[102991]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2fe9a3c4-d9a8-4c71-8f8c-7dc36f9e7df8 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21.6cb84dcf-0fcb-41f2-b1bc-d58a44a322ed" returned: 0 in 1.090s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2fe9a3c4-d9a8-4c71-8f8c-7dc36f9e7df8 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21.6cb84dcf-0fcb-41f2-b1bc-d58a44a322ed {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:05 devstack sudo[102997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21.6cb84dcf-0fcb-41f2-b1bc-d58a44a322ed Jun 29 11:14:05 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2fe9a3c4-d9a8-4c71-8f8c-7dc36f9e7df8 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21.6cb84dcf-0fcb-41f2-b1bc-d58a44a322ed" returned: 0 in 0.975s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:06 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2fe9a3c4-d9a8-4c71-8f8c-7dc36f9e7df8 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Lock "cinder-quobyte-6cb84dcf-0fcb-41f2-b1bc-d58a44a322ed" released by "_delete_snapshot" :: held 4.142s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:14:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2fe9a3c4-d9a8-4c71-8f8c-7dc36f9e7df8 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Lock "cinder-quobyte-1dc7d2ed-87f4-406f-b106-2121ab731b21" released by "delete_snapshot" :: held 4.169s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:14:06 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-2fe9a3c4-d9a8-4c71-8f8c-7dc36f9e7df8 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Created reservations ['26ab3c93-724d-49c5-ad16-001c27a365b8', '4a80fe82-3aaa-4665-bb1d-0c2f53184866', '6d1ddc1a-7a25-491b-a2dc-74170b959a67', 'd2db8cc0-1fd7-4e56-a08c-fb4a435ae6f7'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:14:06 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-2fe9a3c4-d9a8-4c71-8f8c-7dc36f9e7df8 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Delete snapshot completed successfully. Jun 29 11:14:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2fe9a3c4-d9a8-4c71-8f8c-7dc36f9e7df8 tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Lock "cinder-6cb84dcf-0fcb-41f2-b1bc-d58a44a322ed-delete_snapshot" released by "delete_snapshot" :: held 4.396s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:14:08 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-db77be88-395f-44ae-a580-14bf47e79d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Acquiring lock "cinder-1dc7d2ed-87f4-406f-b106-2121ab731b21-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:14:08 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:14:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:14:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:14:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:14:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:14:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:14:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:08 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:14:08 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:08 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-db77be88-395f-44ae-a580-14bf47e79d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Lock "cinder-1dc7d2ed-87f4-406f-b106-2121ab731b21-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:14:08 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-db77be88-395f-44ae-a580-14bf47e79d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Acquiring lock "cinder-quobyte-1dc7d2ed-87f4-406f-b106-2121ab731b21" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:14:08 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-db77be88-395f-44ae-a580-14bf47e79d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Lock "cinder-quobyte-1dc7d2ed-87f4-406f-b106-2121ab731b21" acquired by "delete_volume" :: waited 0.025s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:14:08 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[252c3561-46e8-4257-b32e-32269fe7bf15]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:14:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-db77be88-395f-44ae-a580-14bf47e79d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:08 devstack sudo[103004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21 Jun 29 11:14:08 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:08 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.971s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:09 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:14:09 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager._thread_info {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:14:09 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread count: 28 {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 11:14:09 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread info: [<_MainThread(MainThread, started 131117520400512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 11:14:09 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-db77be88-395f-44ae-a580-14bf47e79d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21" returned: 0 in 1.263s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-db77be88-395f-44ae-a580-14bf47e79d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:09 devstack sudo[103010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21 Jun 29 11:14:09 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:10 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-db77be88-395f-44ae-a580-14bf47e79d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1dc7d2ed-87f4-406f-b106-2121ab731b21" returned: 0 in 0.884s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:10 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-db77be88-395f-44ae-a580-14bf47e79d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Lock "cinder-quobyte-1dc7d2ed-87f4-406f-b106-2121ab731b21" released by "delete_volume" :: held 2.250s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:14:10 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-db77be88-395f-44ae-a580-14bf47e79d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Created reservations ['40cfa728-7c48-4849-b055-e6eb38c91b3d', '6a5b173f-33a2-45cf-949f-7aed387f13bc', 'a67baee7-952f-4b95-b94f-c9a41f5301eb', 'd95bfcf0-6974-40cd-bd48-914b33989265'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:14:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-db77be88-395f-44ae-a580-14bf47e79d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:14:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-db77be88-395f-44ae-a580-14bf47e79d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:14:10 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-db77be88-395f-44ae-a580-14bf47e79d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:14:10 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-db77be88-395f-44ae-a580-14bf47e79d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:14:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-db77be88-395f-44ae-a580-14bf47e79d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:14:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-db77be88-395f-44ae-a580-14bf47e79d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:10 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:14:10 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:11 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-db77be88-395f-44ae-a580-14bf47e79d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.971s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:11 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-db77be88-395f-44ae-a580-14bf47e79d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:14:11 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-db77be88-395f-44ae-a580-14bf47e79d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Deleted volume successfully. Jun 29 11:14:11 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-db77be88-395f-44ae-a580-14bf47e79d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-615651075 None] Lock "cinder-1dc7d2ed-87f4-406f-b106-2121ab731b21-delete_volume" released by "delete_volume" :: held 3.526s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] Flow 'volume_create_manager' (c48f0d57-d392-4605-91ec-ffa7926d28b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af6c9f1-1ca7-44a2-895b-6871e5d5bba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af6c9f1-1ca7-44a2-895b-6871e5d5bba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1978692108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=614ae272-2ade-4b97-bf8b-5e044aeff5c1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='906bd8ac9b8c4074a88789cc4c2384de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:14:13Z,use_quota=True,user_id='baa1f4638dc14601a447951c4c3b616e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7016190-7a25-49da-aaa7-cefae33dbc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7016190-7a25-49da-aaa7-cefae33dbc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb4b1641-13a9-4def-930f-86f0ce5e89a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb4b1641-13a9-4def-930f-86f0ce5e89a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '614ae272-2ade-4b97-bf8b-5e044aeff5c1', 'volume_name': 'volume-614ae272-2ade-4b97-bf8b-5e044aeff5c1', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29fd9e24-e96a-4863-8f6c-abd0dfd37626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29fd9e24-e96a-4863-8f6c-abd0dfd37626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da232b8-39f4-4024-8410-4dadbcbafda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:13 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] Volume 614ae272-2ade-4b97-bf8b-5e044aeff5c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-614ae272-2ade-4b97-bf8b-5e044aeff5c1', 'volume_size': 1} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1978692108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=614ae272-2ade-4b97-bf8b-5e044aeff5c1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='906bd8ac9b8c4074a88789cc4c2384de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:14:13Z,use_quota=True,user_id='baa1f4638dc14601a447951c4c3b616e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] Creating volume 614ae272-2ade-4b97-bf8b-5e044aeff5c1 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:14:13 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-614ae272-2ade-4b97-bf8b-5e044aeff5c1 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:13 devstack sudo[103018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-614ae272-2ade-4b97-bf8b-5e044aeff5c1 1073741824 Jun 29 11:14:13 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] Flow 'volume_create_manager' (eb1dd9cd-dcc3-4d5a-99b0-decdbd8d6ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f0ef6cb-015f-4570-afae-1ba816811b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f0ef6cb-015f-4570-afae-1ba816811b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-772418972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5288846-be83-488e-90c0-87d4e34c925c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbab3a37185346c880990107cf761d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:14:13Z,use_quota=True,user_id='08554852c3524b06a08af49eba1bef2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4da0ad0-1c83-4d8e-aaea-da033779b814),volume_type_id=a4da0ad0-1c83-4d8e-aaea-da033779b814)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de282423-7813-440b-8d35-accb22953637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de282423-7813-440b-8d35-accb22953637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be58afdb-2840-4707-8ef5-9be11b9ff82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be58afdb-2840-4707-8ef5-9be11b9ff82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5288846-be83-488e-90c0-87d4e34c925c', 'volume_name': 'volume-e5288846-be83-488e-90c0-87d4e34c925c', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7d34dfe-3017-41d8-9157-5af990e38b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7d34dfe-3017-41d8-9157-5af990e38b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edca4e95-b0c9-4315-9683-8a94382c874d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:13 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] Volume e5288846-be83-488e-90c0-87d4e34c925c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5288846-be83-488e-90c0-87d4e34c925c', 'volume_size': 1} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] Flow 'volume_create_manager' (0275ed6b-050e-4900-abe6-d0e716d731b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2f7159-bbd1-48ad-ab87-d86ea0f1e4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2f7159-bbd1-48ad-ab87-d86ea0f1e4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1406438643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9f314df-b0e7-485a-96b7-6a80486b86f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbab3a37185346c880990107cf761d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:14:14Z,use_quota=True,user_id='08554852c3524b06a08af49eba1bef2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8418ea8e-7741-4266-94b9-d4122aa930a6),volume_type_id=8418ea8e-7741-4266-94b9-d4122aa930a6)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c11cb0c1-0f08-48bc-8696-7d6da29c5832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c11cb0c1-0f08-48bc-8696-7d6da29c5832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72291035-5fa5-419d-9d1b-1092accd5778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72291035-5fa5-419d-9d1b-1092accd5778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9f314df-b0e7-485a-96b7-6a80486b86f3', 'volume_name': 'volume-d9f314df-b0e7-485a-96b7-6a80486b86f3', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08cf8e09-a441-4de5-b861-bd7c4ef2d6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08cf8e09-a441-4de5-b861-bd7c4ef2d6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8c16da9-0bcf-4810-b2de-82777dc78268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:13 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] Volume d9f314df-b0e7-485a-96b7-6a80486b86f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9f314df-b0e7-485a-96b7-6a80486b86f3', 'volume_size': 1} Jun 29 11:14:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:14:14 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-614ae272-2ade-4b97-bf8b-5e044aeff5c1 1073741824" returned: 0 in 1.255s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-614ae272-2ade-4b97-bf8b-5e044aeff5c1 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:14 devstack sudo[103024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-614ae272-2ade-4b97-bf8b-5e044aeff5c1 Jun 29 11:14:14 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:14 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:14:14 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Flow 'volume_create_manager' (d046f244-ae5a-4c00-9db0-6dcac34bd5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:14:14 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a101969-9efb-4b65-bf2f-c4c7108bfe82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:14 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a101969-9efb-4b65-bf2f-c4c7108bfe82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1580791050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33ac57f4-de16-4d43-b458-f07caa102e3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbab3a37185346c880990107cf761d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:14:15Z,use_quota=True,user_id='08554852c3524b06a08af49eba1bef2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(893a4ff8-45a0-4356-92b2-295d8153a5bf),volume_type_id=893a4ff8-45a0-4356-92b2-295d8153a5bf)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:14 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (435cf52d-969d-4c7b-ac8b-511d1b592386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:14 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (435cf52d-969d-4c7b-ac8b-511d1b592386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:14 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56867239-9521-48c2-a7da-0ee98524be1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:14 devstack cinder-volume[93497]: DEBUG cinder.image.glance [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Creating Keystone auth plugin from conf {{(pid=93497) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 29 11:14:15 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-614ae272-2ade-4b97-bf8b-5e044aeff5c1" returned: 0 in 0.896s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:15 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] <== create_volume: return (2207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:14:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.214s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:14:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.960s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:14:15 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-772418972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5288846-be83-488e-90c0-87d4e34c925c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbab3a37185346c880990107cf761d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:14:13Z,use_quota=True,user_id='08554852c3524b06a08af49eba1bef2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4da0ad0-1c83-4d8e-aaea-da033779b814),volume_type_id=a4da0ad0-1c83-4d8e-aaea-da033779b814)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:14:15 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] Creating volume e5288846-be83-488e-90c0-87d4e34c925c {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:14:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:14:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:14:15 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:14:15 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:14:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:14:15 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:14:15 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:14:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e5288846-be83-488e-90c0-87d4e34c925c 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56867239-9521-48c2-a7da-0ee98524be1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '33ac57f4-de16-4d43-b458-f07caa102e3d', 'volume_name': 'volume-33ac57f4-de16-4d43-b458-f07caa102e3d', 'volume_size': 1, 'image_id': 'd983be9b-c3c6-4361-a7de-444d67a59db7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d983be9b-c3c6-4361-a7de-444d67a59db7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2079979560', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbab3a37185346c880990107cf761d79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd983be9b-c3c6-4361-a7de-444d67a59db7', 'created_at': datetime.datetime(2026, 6, 29, 9, 14, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 9, 14, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d983be9b-c3c6-4361-a7de-444d67a59db7/file', 'properties': {}}, 'image_service': }' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:15 devstack sudo[103027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e5288846-be83-488e-90c0-87d4e34c925c 1073741824 Jun 29 11:14:15 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd315caa-42fd-4fd2-bab8-176edc3df331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd315caa-42fd-4fd2-bab8-176edc3df331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc3b5e39-adef-4634-b8ef-ba1bb9f00c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:15 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Volume 33ac57f4-de16-4d43-b458-f07caa102e3d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-33ac57f4-de16-4d43-b458-f07caa102e3d', 'volume_size': 1, 'image_id': 'd983be9b-c3c6-4361-a7de-444d67a59db7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d983be9b-c3c6-4361-a7de-444d67a59db7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2079979560', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbab3a37185346c880990107cf761d79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd983be9b-c3c6-4361-a7de-444d67a59db7', 'created_at': datetime.datetime(2026, 6, 29, 9, 14, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 9, 14, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d983be9b-c3c6-4361-a7de-444d67a59db7/file', 'properties': {}}, 'image_service': } Jun 29 11:14:15 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Trying to clone 33ac57f4-de16-4d43-b458-f07caa102e3d from image d983be9b-c3c6-4361-a7de-444d67a59db7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d983be9b-c3c6-4361-a7de-444d67a59db7', 'metadata': {}}]). {{(pid=93497) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 29 11:14:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da232b8-39f4-4024-8410-4dadbcbafda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-614ae272-2ade-4b97-bf8b-5e044aeff5c1', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f6e5606-f37b-4311-a1c8-6e01b58fb5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:15 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] Volume volume-614ae272-2ade-4b97-bf8b-5e044aeff5c1 (614ae272-2ade-4b97-bf8b-5e044aeff5c1): created successfully Jun 29 11:14:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f6e5606-f37b-4311-a1c8-6e01b58fb5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] Flow 'volume_create_manager' (c48f0d57-d392-4605-91ec-ffa7926d28b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:14:15 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-110a12f9-772e-4401-8b9b-9a8084c0600c req-1e63dc99-15e4-42d7-acc6-b17458924543 tempest-VolumesGetTestJSON-1673010470 None] Created volume successfully. Jun 29 11:14:16 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e5288846-be83-488e-90c0-87d4e34c925c 1073741824" returned: 0 in 1.104s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e5288846-be83-488e-90c0-87d4e34c925c {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:16 devstack sudo[103034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e5288846-be83-488e-90c0-87d4e34c925c Jun 29 11:14:16 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:16 devstack cinder-volume[93497]: DEBUG cinder.coordination [req-20177846-8454-4d1a-90da-a4fddd84d172 req-8cad5fcd-92e2-4cdd-815c-b7dda269eae8 tempest-VolumesGetTestJSON-1673010470 None] Acquiring lock "cinder-614ae272-2ade-4b97-bf8b-5e044aeff5c1-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:14:16 devstack cinder-volume[93497]: DEBUG cinder.coordination [req-20177846-8454-4d1a-90da-a4fddd84d172 req-8cad5fcd-92e2-4cdd-815c-b7dda269eae8 tempest-VolumesGetTestJSON-1673010470 None] Lock "cinder-614ae272-2ade-4b97-bf8b-5e044aeff5c1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:14:16 devstack cinder-volume[93497]: DEBUG cinder.coordination [req-20177846-8454-4d1a-90da-a4fddd84d172 req-8cad5fcd-92e2-4cdd-815c-b7dda269eae8 tempest-VolumesGetTestJSON-1673010470 None] Acquiring lock "cinder-quobyte-614ae272-2ade-4b97-bf8b-5e044aeff5c1" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:14:17 devstack cinder-volume[93497]: DEBUG cinder.coordination [req-20177846-8454-4d1a-90da-a4fddd84d172 req-8cad5fcd-92e2-4cdd-815c-b7dda269eae8 tempest-VolumesGetTestJSON-1673010470 None] Lock "cinder-quobyte-614ae272-2ade-4b97-bf8b-5e044aeff5c1" acquired by "delete_volume" :: waited 0.036s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:14:17 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9752ae7f-82f0-4dc0-954c-7cd744497a0f]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:14:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-20177846-8454-4d1a-90da-a4fddd84d172 req-8cad5fcd-92e2-4cdd-815c-b7dda269eae8 tempest-VolumesGetTestJSON-1673010470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-614ae272-2ade-4b97-bf8b-5e044aeff5c1 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:17 devstack sudo[103037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-614ae272-2ade-4b97-bf8b-5e044aeff5c1 Jun 29 11:14:17 devstack sudo[103037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:17 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e5288846-be83-488e-90c0-87d4e34c925c" returned: 0 in 0.970s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] <== create_volume: return (2173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:14:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.177s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:14:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.762s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:14:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1406438643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9f314df-b0e7-485a-96b7-6a80486b86f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbab3a37185346c880990107cf761d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:14:14Z,use_quota=True,user_id='08554852c3524b06a08af49eba1bef2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8418ea8e-7741-4266-94b9-d4122aa930a6),volume_type_id=8418ea8e-7741-4266-94b9-d4122aa930a6)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:14:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] Creating volume d9f314df-b0e7-485a-96b7-6a80486b86f3 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:14:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:14:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:14:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:14:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:14:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:14:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:14:17 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:14:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d9f314df-b0e7-485a-96b7-6a80486b86f3 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:17 devstack sudo[103046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d9f314df-b0e7-485a-96b7-6a80486b86f3 1073741824 Jun 29 11:14:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edca4e95-b0c9-4315-9683-8a94382c874d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5288846-be83-488e-90c0-87d4e34c925c', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:17 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42330fd3-60f9-4139-8b65-7610992cc3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:17 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] Volume volume-e5288846-be83-488e-90c0-87d4e34c925c (e5288846-be83-488e-90c0-87d4e34c925c): created successfully Jun 29 11:14:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42330fd3-60f9-4139-8b65-7610992cc3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] Flow 'volume_create_manager' (eb1dd9cd-dcc3-4d5a-99b0-decdbd8d6ae7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:14:17 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-26752a08-e138-432a-8977-d54a43cbbcc6 tempest-TestInstancesWithCinderVolumes-1178480732 None] Created volume successfully. Jun 29 11:14:18 devstack sudo[103037]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-20177846-8454-4d1a-90da-a4fddd84d172 req-8cad5fcd-92e2-4cdd-815c-b7dda269eae8 tempest-VolumesGetTestJSON-1673010470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-614ae272-2ade-4b97-bf8b-5e044aeff5c1" returned: 0 in 1.377s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-20177846-8454-4d1a-90da-a4fddd84d172 req-8cad5fcd-92e2-4cdd-815c-b7dda269eae8 tempest-VolumesGetTestJSON-1673010470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-614ae272-2ade-4b97-bf8b-5e044aeff5c1 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:18 devstack sudo[103052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-614ae272-2ade-4b97-bf8b-5e044aeff5c1 Jun 29 11:14:18 devstack sudo[103052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:19 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d9f314df-b0e7-485a-96b7-6a80486b86f3 1073741824" returned: 0 in 1.512s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d9f314df-b0e7-485a-96b7-6a80486b86f3 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:19 devstack sudo[103068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d9f314df-b0e7-485a-96b7-6a80486b86f3 Jun 29 11:14:19 devstack sudo[103068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:19 devstack sudo[103052]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-20177846-8454-4d1a-90da-a4fddd84d172 req-8cad5fcd-92e2-4cdd-815c-b7dda269eae8 tempest-VolumesGetTestJSON-1673010470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-614ae272-2ade-4b97-bf8b-5e044aeff5c1" returned: 0 in 1.137s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:19 devstack cinder-volume[93497]: DEBUG cinder.coordination [req-20177846-8454-4d1a-90da-a4fddd84d172 req-8cad5fcd-92e2-4cdd-815c-b7dda269eae8 tempest-VolumesGetTestJSON-1673010470 None] Lock "cinder-quobyte-614ae272-2ade-4b97-bf8b-5e044aeff5c1" released by "delete_volume" :: held 2.574s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:14:19 devstack cinder-volume[93497]: DEBUG cinder.quota [req-20177846-8454-4d1a-90da-a4fddd84d172 req-8cad5fcd-92e2-4cdd-815c-b7dda269eae8 tempest-VolumesGetTestJSON-1673010470 None] Created reservations ['8c9103bd-a945-400d-b2fd-964847df1a44', 'ab2e2fd4-b4cd-49b1-b2fa-40c746df1d35', '4c3bf38e-c4cc-4f10-9a82-eb64297d4157', '30e5312f-e478-4c09-b02f-4d455f076712'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:14:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-20177846-8454-4d1a-90da-a4fddd84d172 req-8cad5fcd-92e2-4cdd-815c-b7dda269eae8 tempest-VolumesGetTestJSON-1673010470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:14:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-20177846-8454-4d1a-90da-a4fddd84d172 req-8cad5fcd-92e2-4cdd-815c-b7dda269eae8 tempest-VolumesGetTestJSON-1673010470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:14:19 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [req-20177846-8454-4d1a-90da-a4fddd84d172 req-8cad5fcd-92e2-4cdd-815c-b7dda269eae8 tempest-VolumesGetTestJSON-1673010470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:14:19 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [req-20177846-8454-4d1a-90da-a4fddd84d172 req-8cad5fcd-92e2-4cdd-815c-b7dda269eae8 tempest-VolumesGetTestJSON-1673010470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:14:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-20177846-8454-4d1a-90da-a4fddd84d172 req-8cad5fcd-92e2-4cdd-815c-b7dda269eae8 tempest-VolumesGetTestJSON-1673010470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:14:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-20177846-8454-4d1a-90da-a4fddd84d172 req-8cad5fcd-92e2-4cdd-815c-b7dda269eae8 tempest-VolumesGetTestJSON-1673010470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:19 devstack sudo[103081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:14:19 devstack sudo[103081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:20 devstack sudo[103068]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d9f314df-b0e7-485a-96b7-6a80486b86f3" returned: 0 in 0.909s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:20 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] <== create_volume: return (2511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:14:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.515s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:14:20 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8c16da9-0bcf-4810-b2de-82777dc78268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9f314df-b0e7-485a-96b7-6a80486b86f3', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:20 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a30cc0-d98e-4114-abc4-f79d230495d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:20 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] Volume volume-d9f314df-b0e7-485a-96b7-6a80486b86f3 (d9f314df-b0e7-485a-96b7-6a80486b86f3): created successfully Jun 29 11:14:20 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a30cc0-d98e-4114-abc4-f79d230495d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:20 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] Flow 'volume_create_manager' (0275ed6b-050e-4900-abe6-d0e716d731b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:14:20 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-285d533d-2337-46c7-a508-9f406a2604b2 tempest-TestInstancesWithCinderVolumes-1178480732 None] Created volume successfully. Jun 29 11:14:20 devstack sudo[103081]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-20177846-8454-4d1a-90da-a4fddd84d172 req-8cad5fcd-92e2-4cdd-815c-b7dda269eae8 tempest-VolumesGetTestJSON-1673010470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.941s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:20 devstack cinder-volume[93497]: DEBUG cinder.manager [req-20177846-8454-4d1a-90da-a4fddd84d172 req-8cad5fcd-92e2-4cdd-815c-b7dda269eae8 tempest-VolumesGetTestJSON-1673010470 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:14:20 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-20177846-8454-4d1a-90da-a4fddd84d172 req-8cad5fcd-92e2-4cdd-815c-b7dda269eae8 tempest-VolumesGetTestJSON-1673010470 None] Deleted volume successfully. Jun 29 11:14:20 devstack cinder-volume[93497]: DEBUG cinder.coordination [req-20177846-8454-4d1a-90da-a4fddd84d172 req-8cad5fcd-92e2-4cdd-815c-b7dda269eae8 tempest-VolumesGetTestJSON-1673010470 None] Lock "cinder-614ae272-2ade-4b97-bf8b-5e044aeff5c1-delete_volume" released by "delete_volume" :: held 3.897s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:14:21 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d983be9b-c3c6-4361-a7de-444d67a59db7_3r1obxbsdevstack@QuobyteHD, size 20.69 MB, duration 5.63 sec {{(pid=93497) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 29 11:14:21 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Image download 20.69 MB at 3.67 MB/s Jun 29 11:14:21 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[43289cde-2761-4491-8b49-b13a81104202]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:14:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d983be9b-c3c6-4361-a7de-444d67a59db7_3r1obxbsdevstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:21 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:14:21 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] Flow 'volume_create_manager' (3ca71564-1f63-4690-b2f1-f38649a6d404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:14:21 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2472f026-078e-44a4-8aad-3c89940c51ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:21 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2472f026-078e-44a4-8aad-3c89940c51ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1595875611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c918193a-f08d-488d-9bc5-276b92b0f451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f997d3b5f4e64077bffd48d38bdfa029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:14:21Z,use_quota=True,user_id='32a5fa2c845446839550385617aec704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e4490-76fb-41e8-8ea6-ea8a2a1754d0),volume_type_id=c82e4490-76fb-41e8-8ea6-ea8a2a1754d0)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:21 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ae46e5-f54d-4705-9864-719b206fd53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:21 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ae46e5-f54d-4705-9864-719b206fd53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:21 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b655f053-45fb-4559-9f0b-29a3565ada4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:21 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b655f053-45fb-4559-9f0b-29a3565ada4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c918193a-f08d-488d-9bc5-276b92b0f451', 'volume_name': 'volume-c918193a-f08d-488d-9bc5-276b92b0f451', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:21 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe61a3f-a167-4dba-afcf-6581eb9d7859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:21 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe61a3f-a167-4dba-afcf-6581eb9d7859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:21 devstack sudo[103086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d983be9b-c3c6-4361-a7de-444d67a59db7_3r1obxbsdevstack@QuobyteHD Jun 29 11:14:21 devstack sudo[103086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:21 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806d90af-b8e7-4e84-94b5-bb883c6c70af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:21 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] Volume c918193a-f08d-488d-9bc5-276b92b0f451: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c918193a-f08d-488d-9bc5-276b92b0f451', 'volume_size': 1} Jun 29 11:14:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:14:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:14:21 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1595875611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c918193a-f08d-488d-9bc5-276b92b0f451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f997d3b5f4e64077bffd48d38bdfa029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:14:21Z,use_quota=True,user_id='32a5fa2c845446839550385617aec704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e4490-76fb-41e8-8ea6-ea8a2a1754d0),volume_type_id=c82e4490-76fb-41e8-8ea6-ea8a2a1754d0)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:14:21 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] Creating volume c918193a-f08d-488d-9bc5-276b92b0f451 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:14:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:14:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:14:21 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:14:21 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:14:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:14:21 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:14:21 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:14:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c918193a-f08d-488d-9bc5-276b92b0f451 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:21 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c918193a-f08d-488d-9bc5-276b92b0f451 1073741824 Jun 29 11:14:21 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:22 devstack sudo[103086]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d983be9b-c3c6-4361-a7de-444d67a59db7_3r1obxbsdevstack@QuobyteHD" returned: 0 in 0.875s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:22 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Temporary image d983be9b-c3c6-4361-a7de-444d67a59db7 is fetched for user 08554852c3524b06a08af49eba1bef2c. {{(pid=93497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 29 11:14:22 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be76086-8ac2-4e11-98d4-0183cf7941e3]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:14:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d983be9b-c3c6-4361-a7de-444d67a59db7_3r1obxbsdevstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:22 devstack sudo[103097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d983be9b-c3c6-4361-a7de-444d67a59db7_3r1obxbsdevstack@QuobyteHD Jun 29 11:14:22 devstack sudo[103097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:22 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c918193a-f08d-488d-9bc5-276b92b0f451 1073741824" returned: 0 in 1.178s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c918193a-f08d-488d-9bc5-276b92b0f451 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:22 devstack sudo[103099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c918193a-f08d-488d-9bc5-276b92b0f451 Jun 29 11:14:22 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:23 devstack sudo[103097]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d983be9b-c3c6-4361-a7de-444d67a59db7_3r1obxbsdevstack@QuobyteHD" returned: 0 in 0.938s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:14:23 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c918193a-f08d-488d-9bc5-276b92b0f451" returned: 0 in 0.900s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:23 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] <== create_volume: return (2145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:14:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.147s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:14:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.368s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:14:23 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1580791050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33ac57f4-de16-4d43-b458-f07caa102e3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbab3a37185346c880990107cf761d79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:14:15Z,use_quota=True,user_id='08554852c3524b06a08af49eba1bef2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(893a4ff8-45a0-4356-92b2-295d8153a5bf),volume_type_id=893a4ff8-45a0-4356-92b2-295d8153a5bf)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:14:23 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Creating volume 33ac57f4-de16-4d43-b458-f07caa102e3d {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:14:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:14:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:14:23 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:14:23 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:14:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:14:23 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:14:23 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:14:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806d90af-b8e7-4e84-94b5-bb883c6c70af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c918193a-f08d-488d-9bc5-276b92b0f451', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:23 devstack sudo[103105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d 1073741824 Jun 29 11:14:23 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60607ea1-778b-4d42-a68e-7ea57035b6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:23 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] Volume volume-c918193a-f08d-488d-9bc5-276b92b0f451 (c918193a-f08d-488d-9bc5-276b92b0f451): created successfully Jun 29 11:14:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60607ea1-778b-4d42-a68e-7ea57035b6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] Flow 'volume_create_manager' (3ca71564-1f63-4690-b2f1-f38649a6d404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:14:23 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-f7dca8e0-845e-4278-b24b-17941beb649a tempest-VolumeTypesAccessTest-492241475 None] Created volume successfully. Jun 29 11:14:24 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-407e617a-e229-4467-9f95-cf6bf85b0a66 tempest-VolumeTypesAccessTest-492241475 None] Acquiring lock "cinder-c918193a-f08d-488d-9bc5-276b92b0f451-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:14:24 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-407e617a-e229-4467-9f95-cf6bf85b0a66 tempest-VolumeTypesAccessTest-492241475 None] Lock "cinder-c918193a-f08d-488d-9bc5-276b92b0f451-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:14:24 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d 1073741824" returned: 0 in 1.054s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:24 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-407e617a-e229-4467-9f95-cf6bf85b0a66 tempest-VolumeTypesAccessTest-492241475 None] Acquiring lock "cinder-quobyte-c918193a-f08d-488d-9bc5-276b92b0f451" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:14:24 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-407e617a-e229-4467-9f95-cf6bf85b0a66 tempest-VolumeTypesAccessTest-492241475 None] Lock "cinder-quobyte-c918193a-f08d-488d-9bc5-276b92b0f451" acquired by "delete_volume" :: waited 0.023s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:14:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:24 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d786529-22b6-4332-ae6d-5b1a15e0349f]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:14:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-407e617a-e229-4467-9f95-cf6bf85b0a66 tempest-VolumeTypesAccessTest-492241475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c918193a-f08d-488d-9bc5-276b92b0f451 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:24 devstack sudo[103110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d Jun 29 11:14:24 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:24 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c918193a-f08d-488d-9bc5-276b92b0f451 Jun 29 11:14:24 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:25 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d" returned: 0 in 0.777s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:25 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] <== create_volume: return (1912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:14:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.915s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:14:25 devstack cinder-volume[93497]: DEBUG cinder.volume.volume_utils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Attempting download of d983be9b-c3c6-4361-a7de-444d67a59db7 ((None, [{'url': 'file:///opt/stack/data/glance/images/d983be9b-c3c6-4361-a7de-444d67a59db7', 'metadata': {}}])) to volume 33ac57f4-de16-4d43-b458-f07caa102e3d. {{(pid=93497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 29 11:14:25 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53709f2-9d51-4ad4-9982-89faf559af6b]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:14:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d983be9b-c3c6-4361-a7de-444d67a59db7_q53db9dp {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:25 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-407e617a-e229-4467-9f95-cf6bf85b0a66 tempest-VolumeTypesAccessTest-492241475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c918193a-f08d-488d-9bc5-276b92b0f451" returned: 0 in 0.925s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-407e617a-e229-4467-9f95-cf6bf85b0a66 tempest-VolumeTypesAccessTest-492241475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c918193a-f08d-488d-9bc5-276b92b0f451 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:25 devstack sudo[103122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c918193a-f08d-488d-9bc5-276b92b0f451 Jun 29 11:14:25 devstack sudo[103122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:25 devstack sudo[103121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d983be9b-c3c6-4361-a7de-444d67a59db7_q53db9dp Jun 29 11:14:25 devstack sudo[103121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:26 devstack sudo[103122]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:26 devstack sudo[103121]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-407e617a-e229-4467-9f95-cf6bf85b0a66 tempest-VolumeTypesAccessTest-492241475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c918193a-f08d-488d-9bc5-276b92b0f451" returned: 0 in 0.710s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d983be9b-c3c6-4361-a7de-444d67a59db7_q53db9dp" returned: 0 in 0.789s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d983be9b-c3c6-4361-a7de-444d67a59db7_q53db9dp {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:26 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-407e617a-e229-4467-9f95-cf6bf85b0a66 tempest-VolumeTypesAccessTest-492241475 None] Lock "cinder-quobyte-c918193a-f08d-488d-9bc5-276b92b0f451" released by "delete_volume" :: held 1.692s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:14:26 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=79,cinder:UPDATE=99,cinder:INSERT=22,cinder:DELETE=7 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:14:26 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:UPDATE=101,cinder:DELETE=9,cinder:SELECT=84,cinder:INSERT=24 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:14:26 devstack cinder-volume[93497]: WARNING cinder.quota [None req-407e617a-e229-4467-9f95-cf6bf85b0a66 tempest-VolumeTypesAccessTest-492241475 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-634064722 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-634064722, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:14:26 devstack cinder-volume[93497]: WARNING cinder.quota [None req-407e617a-e229-4467-9f95-cf6bf85b0a66 tempest-VolumeTypesAccessTest-492241475 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-634064722 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-634064722, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:14:26 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-407e617a-e229-4467-9f95-cf6bf85b0a66 tempest-VolumeTypesAccessTest-492241475 None] Created reservations ['087408e5-96bd-4acf-ae72-4f5011c84b6f', 'd85b3447-8c50-4c84-a853-3a6959249e51', '2d2c2855-ed63-4f2a-bd14-4b00024f08d4', '15da075c-d167-4338-a428-d1896002dbcf'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:14:26 devstack sudo[103128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d983be9b-c3c6-4361-a7de-444d67a59db7_q53db9dp Jun 29 11:14:26 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-407e617a-e229-4467-9f95-cf6bf85b0a66 tempest-VolumeTypesAccessTest-492241475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:14:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-407e617a-e229-4467-9f95-cf6bf85b0a66 tempest-VolumeTypesAccessTest-492241475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:14:26 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-407e617a-e229-4467-9f95-cf6bf85b0a66 tempest-VolumeTypesAccessTest-492241475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:14:26 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-407e617a-e229-4467-9f95-cf6bf85b0a66 tempest-VolumeTypesAccessTest-492241475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:14:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-407e617a-e229-4467-9f95-cf6bf85b0a66 tempest-VolumeTypesAccessTest-492241475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:14:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-407e617a-e229-4467-9f95-cf6bf85b0a66 tempest-VolumeTypesAccessTest-492241475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:26 devstack sudo[103133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:14:26 devstack sudo[103133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d983be9b-c3c6-4361-a7de-444d67a59db7_q53db9dp" returned: 1 in 1.143s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:27 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d983be9b-c3c6-4361-a7de-444d67a59db7_q53db9dp' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:14:27 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e74f2f-a456-4e1b-b757-dfec8aca56bf]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:14:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d983be9b-c3c6-4361-a7de-444d67a59db7_3r1obxbsdevstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:27 devstack sudo[103163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d983be9b-c3c6-4361-a7de-444d67a59db7_3r1obxbsdevstack@QuobyteHD Jun 29 11:14:27 devstack sudo[103163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-407e617a-e229-4467-9f95-cf6bf85b0a66 tempest-VolumeTypesAccessTest-492241475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.702s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:28 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-407e617a-e229-4467-9f95-cf6bf85b0a66 tempest-VolumeTypesAccessTest-492241475 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:14:28 devstack sudo[103133]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:28 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-407e617a-e229-4467-9f95-cf6bf85b0a66 tempest-VolumeTypesAccessTest-492241475 None] Deleted volume successfully. Jun 29 11:14:28 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-407e617a-e229-4467-9f95-cf6bf85b0a66 tempest-VolumeTypesAccessTest-492241475 None] Lock "cinder-c918193a-f08d-488d-9bc5-276b92b0f451-delete_volume" released by "delete_volume" :: held 3.771s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:14:29 devstack sudo[103163]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d983be9b-c3c6-4361-a7de-444d67a59db7_3r1obxbsdevstack@QuobyteHD" returned: 0 in 1.552s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:29 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] d983be9b-c3c6-4361-a7de-444d67a59db7 was qcow2, converting to raw {{(pid=93497) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 29 11:14:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d983be9b-c3c6-4361-a7de-444d67a59db7_3r1obxbsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:29 devstack sudo[103220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d983be9b-c3c6-4361-a7de-444d67a59db7_3r1obxbsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d Jun 29 11:14:29 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:32 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d983be9b-c3c6-4361-a7de-444d67a59db7_3r1obxbsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d" returned: 0 in 3.517s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:32 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d983be9b-c3c6-4361-a7de-444d67a59db7_3r1obxbsdevstack@QuobyteHD, size 112.00 MB, duration 3.52 sec, destination /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d {{(pid=93497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 11:14:32 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Converted 112.00 MB image at 31.81 MB/s Jun 29 11:14:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:32 devstack sudo[103230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d 1G Jun 29 11:14:32 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:33 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d 1G" returned: 0 in 1.309s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:34 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b74846a-1418-4c5a-964b-ab5b1e80d3b4]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:14:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:34 devstack sudo[103235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d Jun 29 11:14:34 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:35 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d" returned: 0 in 1.436s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:35 devstack sudo[103240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d Jun 29 11:14:35 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:36 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:INSERT=2,cinder:UPDATE=10,cinder:SELECT=2 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:14:36 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d" returned: 1 in 1.288s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:14:36 devstack cinder-volume[93497]: DEBUG cinder.volume.volume_utils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Downloaded image d983be9b-c3c6-4361-a7de-444d67a59db7 ((None, [{'url': 'file:///opt/stack/data/glance/images/d983be9b-c3c6-4361-a7de-444d67a59db7', 'metadata': {}}])) to volume 33ac57f4-de16-4d43-b458-f07caa102e3d successfully. {{(pid=93497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 29 11:14:36 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Temporary image d983be9b-c3c6-4361-a7de-444d67a59db7 for user 08554852c3524b06a08af49eba1bef2c is deleted. {{(pid=93497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 29 11:14:36 devstack cinder-volume[93497]: DEBUG cinder.volume.volume_utils [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Marking volume 33ac57f4-de16-4d43-b458-f07caa102e3d as bootable. {{(pid=93497) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 29 11:14:36 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Copying metadata from image d983be9b-c3c6-4361-a7de-444d67a59db7 to 33ac57f4-de16-4d43-b458-f07caa102e3d. {{(pid=93497) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 29 11:14:36 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Creating volume glance metadata for volume 33ac57f4-de16-4d43-b458-f07caa102e3d backed by image d983be9b-c3c6-4361-a7de-444d67a59db7 with: {'image_id': 'd983be9b-c3c6-4361-a7de-444d67a59db7', 'image_name': 'tempest-scenario-img--2079979560', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93497) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 29 11:14:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc3b5e39-adef-4634-b8ef-ba1bb9f00c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33ac57f4-de16-4d43-b458-f07caa102e3d', 'volume_size': 1, 'image_id': 'd983be9b-c3c6-4361-a7de-444d67a59db7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d983be9b-c3c6-4361-a7de-444d67a59db7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2079979560', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'dbab3a37185346c880990107cf761d79', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd983be9b-c3c6-4361-a7de-444d67a59db7', 'created_at': datetime.datetime(2026, 6, 29, 9, 14, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 9, 14, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d983be9b-c3c6-4361-a7de-444d67a59db7/file', 'properties': {}}, 'image_service': }' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56443583-0782-47a0-9914-e97a4eeded8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:36 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Volume volume-33ac57f4-de16-4d43-b458-f07caa102e3d (33ac57f4-de16-4d43-b458-f07caa102e3d): created successfully Jun 29 11:14:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56443583-0782-47a0-9914-e97a4eeded8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:37 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Flow 'volume_create_manager' (d046f244-ae5a-4c00-9db0-6dcac34bd5c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:14:37 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-90f71884-f798-4d17-a601-d5d9db1cea1a tempest-TestInstancesWithCinderVolumes-1178480732 None] Created volume successfully. Jun 29 11:14:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-9267a69a-0712-401b-82e2-7b15cd27c543 req-dc6abedf-a5a3-4cbb-94dc-190fa9306275 tempest-TestInstancesWithCinderVolumes-1178480732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:14:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-9267a69a-0712-401b-82e2-7b15cd27c543 req-dc6abedf-a5a3-4cbb-94dc-190fa9306275 tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:14:46 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd8ebb3-5cf7-4658-819d-72dcc9c13180]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:14:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-9267a69a-0712-401b-82e2-7b15cd27c543 req-dc6abedf-a5a3-4cbb-94dc-190fa9306275 tempest-TestInstancesWithCinderVolumes-1178480732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:46 devstack sudo[103281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d Jun 29 11:14:46 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:47 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:14:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] Flow 'volume_create_manager' (a0955918-4762-44a4-8833-98f1299b5145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:14:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5987aee-6418-4176-bf75-789c65bb83a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5987aee-6418-4176-bf75-789c65bb83a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1657550520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d21ce8f7-9752-4f41-ba61-feb8e0cadc18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bb2dee4db654d24bd417efc80bd84bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:14:47Z,use_quota=True,user_id='ec2b761a338a4465a12edf29023e44b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aa8e3c9-e1cb-4ac3-ab9c-62e7fe913d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aa8e3c9-e1cb-4ac3-ab9c-62e7fe913d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:47 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d3af74-b4a7-4964-b100-69672b69ea96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d3af74-b4a7-4964-b100-69672b69ea96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd21ce8f7-9752-4f41-ba61-feb8e0cadc18', 'volume_name': 'volume-d21ce8f7-9752-4f41-ba61-feb8e0cadc18', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9600e8-bc1d-4169-9acf-8790ac86e4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9600e8-bc1d-4169-9acf-8790ac86e4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (633f5523-222c-4c58-bd4e-7afe55f15c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:47 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] Volume d21ce8f7-9752-4f41-ba61-feb8e0cadc18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d21ce8f7-9752-4f41-ba61-feb8e0cadc18', 'volume_size': 1} Jun 29 11:14:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:14:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-9267a69a-0712-401b-82e2-7b15cd27c543 req-dc6abedf-a5a3-4cbb-94dc-190fa9306275 tempest-TestInstancesWithCinderVolumes-1178480732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d" returned: 0 in 0.971s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-9267a69a-0712-401b-82e2-7b15cd27c543 req-dc6abedf-a5a3-4cbb-94dc-190fa9306275 tempest-TestInstancesWithCinderVolumes-1178480732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:47 devstack sudo[103286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d Jun 29 11:14:47 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:48 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-9267a69a-0712-401b-82e2-7b15cd27c543 req-dc6abedf-a5a3-4cbb-94dc-190fa9306275 tempest-TestInstancesWithCinderVolumes-1178480732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d" returned: 1 in 0.912s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-9267a69a-0712-401b-82e2-7b15cd27c543 req-dc6abedf-a5a3-4cbb-94dc-190fa9306275 tempest-TestInstancesWithCinderVolumes-1178480732 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:14:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-9267a69a-0712-401b-82e2-7b15cd27c543 req-dc6abedf-a5a3-4cbb-94dc-190fa9306275 tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.953s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:14:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.922s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:14:48 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1657550520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d21ce8f7-9752-4f41-ba61-feb8e0cadc18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bb2dee4db654d24bd417efc80bd84bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:14:47Z,use_quota=True,user_id='ec2b761a338a4465a12edf29023e44b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:14:48 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] Creating volume d21ce8f7-9752-4f41-ba61-feb8e0cadc18 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:14:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:14:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:14:48 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:14:48 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:14:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:14:48 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:14:48 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:14:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d21ce8f7-9752-4f41-ba61-feb8e0cadc18 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:48 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d21ce8f7-9752-4f41-ba61-feb8e0cadc18 1073741824 Jun 29 11:14:48 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:48 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-9267a69a-0712-401b-82e2-7b15cd27c543 req-dc6abedf-a5a3-4cbb-94dc-190fa9306275 tempest-TestInstancesWithCinderVolumes-1178480732 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3', 'name': 'volume-33ac57f4-de16-4d43-b458-f07caa102e3d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '45728ed3-fda7-44d7-ab2f-8669718c078e', 'enforce_multipath': True} {{(pid=93497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 11:14:48 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-9267a69a-0712-401b-82e2-7b15cd27c543 req-dc6abedf-a5a3-4cbb-94dc-190fa9306275 tempest-TestInstancesWithCinderVolumes-1178480732 None] attachment_update completed successfully. Jun 29 11:14:49 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d21ce8f7-9752-4f41-ba61-feb8e0cadc18 1073741824" returned: 0 in 1.181s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d21ce8f7-9752-4f41-ba61-feb8e0cadc18 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:49 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d21ce8f7-9752-4f41-ba61-feb8e0cadc18 Jun 29 11:14:49 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:50 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d21ce8f7-9752-4f41-ba61-feb8e0cadc18" returned: 0 in 0.863s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] <== create_volume: return (2124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:14:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.128s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:14:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (633f5523-222c-4c58-bd4e-7afe55f15c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d21ce8f7-9752-4f41-ba61-feb8e0cadc18', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e57ad707-406b-4166-b466-128cc5fdf05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:50 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] Volume volume-d21ce8f7-9752-4f41-ba61-feb8e0cadc18 (d21ce8f7-9752-4f41-ba61-feb8e0cadc18): created successfully Jun 29 11:14:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e57ad707-406b-4166-b466-128cc5fdf05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] Flow 'volume_create_manager' (a0955918-4762-44a4-8833-98f1299b5145) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:14:50 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-400575b5-3287-4922-9441-880fd6b02917 tempest-VolumesListAdminTestJSON-775222345 None] Created volume successfully. Jun 29 11:14:51 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:14:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] Flow 'volume_create_manager' (dd20ee7d-d97b-4dc8-9416-e3a345f57ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:14:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5112a53-a201-4a0a-bd5f-9b14ee175e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5112a53-a201-4a0a-bd5f-9b14ee175e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-154532513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b832e3b-3e9b-44c7-9dd9-9778f4b147ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bb2dee4db654d24bd417efc80bd84bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:14:52Z,use_quota=True,user_id='ec2b761a338a4465a12edf29023e44b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43fe6264-1610-4908-8d09-d71f1cd97a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43fe6264-1610-4908-8d09-d71f1cd97a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e9c93b1-87f9-431a-8a8b-20d0a39be74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e9c93b1-87f9-431a-8a8b-20d0a39be74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b832e3b-3e9b-44c7-9dd9-9778f4b147ab', 'volume_name': 'volume-9b832e3b-3e9b-44c7-9dd9-9778f4b147ab', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb32173-b56d-407a-b483-be8e791108ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb32173-b56d-407a-b483-be8e791108ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (444edc84-abf2-40f8-b7eb-8e970fcb6dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:51 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] Volume 9b832e3b-3e9b-44c7-9dd9-9778f4b147ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b832e3b-3e9b-44c7-9dd9-9778f4b147ab', 'volume_size': 1} Jun 29 11:14:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:14:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:14:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:14:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-154532513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b832e3b-3e9b-44c7-9dd9-9778f4b147ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bb2dee4db654d24bd417efc80bd84bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:14:52Z,use_quota=True,user_id='ec2b761a338a4465a12edf29023e44b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:14:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] Creating volume 9b832e3b-3e9b-44c7-9dd9-9778f4b147ab {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:14:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:14:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:14:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:14:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:14:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:14:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:14:51 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:14:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-9b832e3b-3e9b-44c7-9dd9-9778f4b147ab 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:51 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-9b832e3b-3e9b-44c7-9dd9-9778f4b147ab 1073741824 Jun 29 11:14:51 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:52 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-9b832e3b-3e9b-44c7-9dd9-9778f4b147ab 1073741824" returned: 0 in 0.920s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-9b832e3b-3e9b-44c7-9dd9-9778f4b147ab {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:52 devstack sudo[103417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-9b832e3b-3e9b-44c7-9dd9-9778f4b147ab Jun 29 11:14:52 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:53 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-9b832e3b-3e9b-44c7-9dd9-9778f4b147ab" returned: 0 in 0.687s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:14:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:14:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (444edc84-abf2-40f8-b7eb-8e970fcb6dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b832e3b-3e9b-44c7-9dd9-9778f4b147ab', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7829033c-ddca-4e4d-9930-f683284e86bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:53 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] Volume volume-9b832e3b-3e9b-44c7-9dd9-9778f4b147ab (9b832e3b-3e9b-44c7-9dd9-9778f4b147ab): created successfully Jun 29 11:14:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7829033c-ddca-4e4d-9930-f683284e86bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] Flow 'volume_create_manager' (dd20ee7d-d97b-4dc8-9416-e3a345f57ae5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:14:53 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-c21b78dd-a2e4-4799-9c6b-29ba6bc01151 tempest-VolumesListAdminTestJSON-775222345 None] Created volume successfully. Jun 29 11:14:54 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:14:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] Flow 'volume_create_manager' (cd233e4a-a88a-42d5-92a3-060f1d6bc4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:14:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b297b7-e4a1-4b80-bf19-4d2a561cf6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1b297b7-e4a1-4b80-bf19-4d2a561cf6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-412563339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea8b0d88-b70f-4751-9825-a90b676657cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bb2dee4db654d24bd417efc80bd84bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:14:54Z,use_quota=True,user_id='ec2b761a338a4465a12edf29023e44b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bfc197d-0bf6-4a4e-88a9-356fb972d8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bfc197d-0bf6-4a4e-88a9-356fb972d8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed4279c3-f0ab-4fa4-92fe-e9252f15c4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed4279c3-f0ab-4fa4-92fe-e9252f15c4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea8b0d88-b70f-4751-9825-a90b676657cb', 'volume_name': 'volume-ea8b0d88-b70f-4751-9825-a90b676657cb', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b253970-d6a6-4b71-bce6-9a4bf4456735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b253970-d6a6-4b71-bce6-9a4bf4456735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec0cd89-26cc-448c-94b4-e810768aedfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:54 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] Volume ea8b0d88-b70f-4751-9825-a90b676657cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea8b0d88-b70f-4751-9825-a90b676657cb', 'volume_size': 1} Jun 29 11:14:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:14:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:14:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-412563339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea8b0d88-b70f-4751-9825-a90b676657cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bb2dee4db654d24bd417efc80bd84bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:14:54Z,use_quota=True,user_id='ec2b761a338a4465a12edf29023e44b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:14:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] Creating volume ea8b0d88-b70f-4751-9825-a90b676657cb {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:14:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:14:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:14:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:14:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:14:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:14:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:14:54 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:14:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ea8b0d88-b70f-4751-9825-a90b676657cb 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:54 devstack sudo[103743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ea8b0d88-b70f-4751-9825-a90b676657cb 1073741824 Jun 29 11:14:54 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:55 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ea8b0d88-b70f-4751-9825-a90b676657cb 1073741824" returned: 0 in 1.555s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ea8b0d88-b70f-4751-9825-a90b676657cb {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:56 devstack sudo[103814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ea8b0d88-b70f-4751-9825-a90b676657cb Jun 29 11:14:56 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:56 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:14:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] Flow 'volume_create_manager' (e5cd73b6-6a40-435a-82d9-e0fb866e3999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:14:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfeeef24-58e4-4624-9f1d-dd7c5947a53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfeeef24-58e4-4624-9f1d-dd7c5947a53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1686961766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63c2dc4b-bd08-4207-95d0-91ff88cb1b5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6152cfa9d1478d850e417348a1c4dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:14:56Z,use_quota=True,user_id='62e68c840d124d71b52de38778cc57d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c62ad2c5-e755-4df4-9925-aeeb7cbdf416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c62ad2c5-e755-4df4-9925-aeeb7cbdf416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d34c23e6-5e7b-4c88-bab2-55625435fbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d34c23e6-5e7b-4c88-bab2-55625435fbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63c2dc4b-bd08-4207-95d0-91ff88cb1b5d', 'volume_name': 'volume-63c2dc4b-bd08-4207-95d0-91ff88cb1b5d', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed6a972d-fbd8-4364-b6ec-867c615090d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed6a972d-fbd8-4364-b6ec-867c615090d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58bd77a3-65c6-4fc7-a1ec-97527bcc2093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:56 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] Volume 63c2dc4b-bd08-4207-95d0-91ff88cb1b5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63c2dc4b-bd08-4207-95d0-91ff88cb1b5d', 'volume_size': 1} Jun 29 11:14:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:14:56 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ea8b0d88-b70f-4751-9825-a90b676657cb" returned: 0 in 0.836s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] <== create_volume: return (2514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:14:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.515s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:14:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.380s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:14:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1686961766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63c2dc4b-bd08-4207-95d0-91ff88cb1b5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6152cfa9d1478d850e417348a1c4dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:14:56Z,use_quota=True,user_id='62e68c840d124d71b52de38778cc57d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:14:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] Creating volume 63c2dc4b-bd08-4207-95d0-91ff88cb1b5d {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:14:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:14:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:14:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:14:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:14:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:14:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:14:56 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:14:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-63c2dc4b-bd08-4207-95d0-91ff88cb1b5d 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec0cd89-26cc-448c-94b4-e810768aedfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea8b0d88-b70f-4751-9825-a90b676657cb', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (216b5264-c616-4cd5-be71-cd4423132789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:56 devstack sudo[103821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-63c2dc4b-bd08-4207-95d0-91ff88cb1b5d 1073741824 Jun 29 11:14:57 devstack sudo[103821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:57 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] Volume volume-ea8b0d88-b70f-4751-9825-a90b676657cb (ea8b0d88-b70f-4751-9825-a90b676657cb): created successfully Jun 29 11:14:57 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (216b5264-c616-4cd5-be71-cd4423132789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:57 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] Flow 'volume_create_manager' (cd233e4a-a88a-42d5-92a3-060f1d6bc4c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:14:57 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-c270656d-f9f3-4ea3-826a-fa43478cdde6 tempest-VolumesListAdminTestJSON-775222345 None] Created volume successfully. Jun 29 11:14:58 devstack sudo[103821]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-63c2dc4b-bd08-4207-95d0-91ff88cb1b5d 1073741824" returned: 0 in 1.466s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-63c2dc4b-bd08-4207-95d0-91ff88cb1b5d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:58 devstack sudo[103827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-63c2dc4b-bd08-4207-95d0-91ff88cb1b5d Jun 29 11:14:58 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:59 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:14:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] Flow 'volume_create_manager' (03ac6fe1-5624-42c0-8bb8-fb3525dedfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:14:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (496ef9ab-4fdb-4e9f-a820-e0c6592be831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (496ef9ab-4fdb-4e9f-a820-e0c6592be831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b98a2a7-9da4-44bd-823c-ad2226927922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a52dd487919e48caaa8c8bfe66d8928e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:14:59Z,use_quota=True,user_id='f6b17dce17e94baebadc51498f447c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d8040d5-627e-46b5-8951-1819332ec140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d8040d5-627e-46b5-8951-1819332ec140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d489bd5f-4c3d-49d6-ad75-06c4773b9ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d489bd5f-4c3d-49d6-ad75-06c4773b9ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b98a2a7-9da4-44bd-823c-ad2226927922', 'volume_name': 'volume-1b98a2a7-9da4-44bd-823c-ad2226927922', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20988f6f-ce5b-4e1a-bd47-69fc75b53dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20988f6f-ce5b-4e1a-bd47-69fc75b53dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (785fe69d-2b71-47b3-b9c4-55ad863c2f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:59 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] Volume 1b98a2a7-9da4-44bd-823c-ad2226927922: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b98a2a7-9da4-44bd-823c-ad2226927922', 'volume_size': 1} Jun 29 11:14:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:14:59 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root Jun 29 11:14:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-63c2dc4b-bd08-4207-95d0-91ff88cb1b5d" returned: 0 in 1.219s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:14:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] <== create_volume: return (2748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:14:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.751s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:14:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.265s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:14:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b98a2a7-9da4-44bd-823c-ad2226927922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a52dd487919e48caaa8c8bfe66d8928e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:14:59Z,use_quota=True,user_id='f6b17dce17e94baebadc51498f447c32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:14:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] Creating volume 1b98a2a7-9da4-44bd-823c-ad2226927922 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:14:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:14:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:14:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:14:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:14:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:14:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:14:59 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:14:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1b98a2a7-9da4-44bd-823c-ad2226927922 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:14:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58bd77a3-65c6-4fc7-a1ec-97527bcc2093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63c2dc4b-bd08-4207-95d0-91ff88cb1b5d', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a353423-37a4-4756-b3d0-7375ad96961d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:14:59 devstack sudo[103830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1b98a2a7-9da4-44bd-823c-ad2226927922 1073741824 Jun 29 11:14:59 devstack sudo[103830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:14:59 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] Volume volume-63c2dc4b-bd08-4207-95d0-91ff88cb1b5d (63c2dc4b-bd08-4207-95d0-91ff88cb1b5d): created successfully Jun 29 11:14:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a353423-37a4-4756-b3d0-7375ad96961d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:14:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] Flow 'volume_create_manager' (e5cd73b6-6a40-435a-82d9-e0fb866e3999) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:14:59 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-994dfc2d-e952-45ea-bd0a-40a81d1e84ac tempest-AttachVolumeNegativeTest-1748370238 None] Created volume successfully. Jun 29 11:15:01 devstack sudo[103830]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1b98a2a7-9da4-44bd-823c-ad2226927922 1073741824" returned: 0 in 1.415s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1b98a2a7-9da4-44bd-823c-ad2226927922 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:01 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1b98a2a7-9da4-44bd-823c-ad2226927922 Jun 29 11:15:01 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:02 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1b98a2a7-9da4-44bd-823c-ad2226927922" returned: 0 in 1.274s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:02 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] <== create_volume: return (2788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:15:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.792s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:15:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (785fe69d-2b71-47b3-b9c4-55ad863c2f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b98a2a7-9da4-44bd-823c-ad2226927922', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:15:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf170fb1-61a5-4ccf-a10c-39a775d3a06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:15:02 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] Volume volume-1b98a2a7-9da4-44bd-823c-ad2226927922 (1b98a2a7-9da4-44bd-823c-ad2226927922): created successfully Jun 29 11:15:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf170fb1-61a5-4ccf-a10c-39a775d3a06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:15:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] Flow 'volume_create_manager' (03ac6fe1-5624-42c0-8bb8-fb3525dedfe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:15:02 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-beffaa68-868c-477f-aaa4-239c3dd966c3 tempest-VolumesListAdminTestJSON-368112906 None] Created volume successfully. Jun 29 11:15:02 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-30630ec7-a17e-43a9-9f37-a052fa7471ec tempest-VolumesListAdminTestJSON-368112906 None] Acquiring lock "cinder-1b98a2a7-9da4-44bd-823c-ad2226927922-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:15:02 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-30630ec7-a17e-43a9-9f37-a052fa7471ec tempest-VolumesListAdminTestJSON-368112906 None] Lock "cinder-1b98a2a7-9da4-44bd-823c-ad2226927922-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:15:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-30630ec7-a17e-43a9-9f37-a052fa7471ec tempest-VolumesListAdminTestJSON-368112906 None] Acquiring lock "cinder-quobyte-1b98a2a7-9da4-44bd-823c-ad2226927922" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:15:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-30630ec7-a17e-43a9-9f37-a052fa7471ec tempest-VolumesListAdminTestJSON-368112906 None] Lock "cinder-quobyte-1b98a2a7-9da4-44bd-823c-ad2226927922" acquired by "delete_volume" :: waited 0.040s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:15:03 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c31655-b8d4-429f-aad6-19713618460d]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:15:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-30630ec7-a17e-43a9-9f37-a052fa7471ec tempest-VolumesListAdminTestJSON-368112906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1b98a2a7-9da4-44bd-823c-ad2226927922 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-347bdc5b-0157-49e2-a8fc-d370888be770 tempest-VolumesListAdminTestJSON-775222345 None] Acquiring lock "cinder-ea8b0d88-b70f-4751-9825-a90b676657cb-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:15:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-347bdc5b-0157-49e2-a8fc-d370888be770 tempest-VolumesListAdminTestJSON-775222345 None] Lock "cinder-ea8b0d88-b70f-4751-9825-a90b676657cb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:15:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-347bdc5b-0157-49e2-a8fc-d370888be770 tempest-VolumesListAdminTestJSON-775222345 None] Acquiring lock "cinder-quobyte-ea8b0d88-b70f-4751-9825-a90b676657cb" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:15:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-347bdc5b-0157-49e2-a8fc-d370888be770 tempest-VolumesListAdminTestJSON-775222345 None] Lock "cinder-quobyte-ea8b0d88-b70f-4751-9825-a90b676657cb" acquired by "delete_volume" :: waited 0.029s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:15:03 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac3fa11-e1db-452a-b8f0-247fb0e9f48e]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:15:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-347bdc5b-0157-49e2-a8fc-d370888be770 tempest-VolumesListAdminTestJSON-775222345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ea8b0d88-b70f-4751-9825-a90b676657cb {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:03 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1b98a2a7-9da4-44bd-823c-ad2226927922 Jun 29 11:15:03 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:03 devstack sudo[103843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ea8b0d88-b70f-4751-9825-a90b676657cb Jun 29 11:15:03 devstack sudo[103843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-d73f60fa-cbee-4325-9522-d117414a904c req-0c139dde-da0c-4ec7-9fad-02880e1e0498 tempest-AttachVolumeNegativeTest-1748370238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:15:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-d73f60fa-cbee-4325-9522-d117414a904c req-0c139dde-da0c-4ec7-9fad-02880e1e0498 tempest-AttachVolumeNegativeTest-1748370238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:15:04 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4848c8d5-a8f4-48cd-8942-65f6710ea7cb]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:15:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-d73f60fa-cbee-4325-9522-d117414a904c req-0c139dde-da0c-4ec7-9fad-02880e1e0498 tempest-AttachVolumeNegativeTest-1748370238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-63c2dc4b-bd08-4207-95d0-91ff88cb1b5d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:04 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-63c2dc4b-bd08-4207-95d0-91ff88cb1b5d Jun 29 11:15:04 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:05 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-30630ec7-a17e-43a9-9f37-a052fa7471ec tempest-VolumesListAdminTestJSON-368112906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1b98a2a7-9da4-44bd-823c-ad2226927922" returned: 0 in 1.855s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-30630ec7-a17e-43a9-9f37-a052fa7471ec tempest-VolumesListAdminTestJSON-368112906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1b98a2a7-9da4-44bd-823c-ad2226927922 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:05 devstack sudo[103843]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-347bdc5b-0157-49e2-a8fc-d370888be770 tempest-VolumesListAdminTestJSON-775222345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ea8b0d88-b70f-4751-9825-a90b676657cb" returned: 0 in 1.621s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-347bdc5b-0157-49e2-a8fc-d370888be770 tempest-VolumesListAdminTestJSON-775222345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ea8b0d88-b70f-4751-9825-a90b676657cb {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:05 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1b98a2a7-9da4-44bd-823c-ad2226927922 Jun 29 11:15:05 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:05 devstack sudo[103865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ea8b0d88-b70f-4751-9825-a90b676657cb Jun 29 11:15:05 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:06 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-30630ec7-a17e-43a9-9f37-a052fa7471ec tempest-VolumesListAdminTestJSON-368112906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1b98a2a7-9da4-44bd-823c-ad2226927922" returned: 0 in 1.390s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-30630ec7-a17e-43a9-9f37-a052fa7471ec tempest-VolumesListAdminTestJSON-368112906 None] Lock "cinder-quobyte-1b98a2a7-9da4-44bd-823c-ad2226927922" released by "delete_volume" :: held 3.382s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:15:06 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-347bdc5b-0157-49e2-a8fc-d370888be770 tempest-VolumesListAdminTestJSON-775222345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ea8b0d88-b70f-4751-9825-a90b676657cb" returned: 0 in 1.418s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-347bdc5b-0157-49e2-a8fc-d370888be770 tempest-VolumesListAdminTestJSON-775222345 None] Lock "cinder-quobyte-ea8b0d88-b70f-4751-9825-a90b676657cb" released by "delete_volume" :: held 3.175s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:15:06 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-30630ec7-a17e-43a9-9f37-a052fa7471ec tempest-VolumesListAdminTestJSON-368112906 None] Created reservations ['e83cec21-4ecc-4d52-afcb-ae05f5e37c05', 'b14ee1d1-6b95-47ad-bc20-65f8a68941a2', '4d77b7bc-3854-4489-a739-d29a24c5325a', '3c2c6ded-6782-4087-8184-fceb501fb61f'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:15:06 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-347bdc5b-0157-49e2-a8fc-d370888be770 tempest-VolumesListAdminTestJSON-775222345 None] Created reservations ['4c17683d-35a8-498d-9320-7fe0b9f969bc', '4c806387-3574-4f12-8d30-97a1ddb704c9', '70c0dae9-7b56-4688-b2e5-115e8474d458', '135f6522-cd91-42ee-bfda-1926a763b78e'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:15:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-30630ec7-a17e-43a9-9f37-a052fa7471ec tempest-VolumesListAdminTestJSON-368112906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:15:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-30630ec7-a17e-43a9-9f37-a052fa7471ec tempest-VolumesListAdminTestJSON-368112906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:15:06 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-30630ec7-a17e-43a9-9f37-a052fa7471ec tempest-VolumesListAdminTestJSON-368112906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:15:07 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:07 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-30630ec7-a17e-43a9-9f37-a052fa7471ec tempest-VolumesListAdminTestJSON-368112906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:15:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-30630ec7-a17e-43a9-9f37-a052fa7471ec tempest-VolumesListAdminTestJSON-368112906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:15:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-30630ec7-a17e-43a9-9f37-a052fa7471ec tempest-VolumesListAdminTestJSON-368112906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-d73f60fa-cbee-4325-9522-d117414a904c req-0c139dde-da0c-4ec7-9fad-02880e1e0498 tempest-AttachVolumeNegativeTest-1748370238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-63c2dc4b-bd08-4207-95d0-91ff88cb1b5d" returned: 0 in 2.329s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-d73f60fa-cbee-4325-9522-d117414a904c req-0c139dde-da0c-4ec7-9fad-02880e1e0498 tempest-AttachVolumeNegativeTest-1748370238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.381s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:15:07 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:15:07 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-347bdc5b-0157-49e2-a8fc-d370888be770 tempest-VolumesListAdminTestJSON-775222345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:15:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-347bdc5b-0157-49e2-a8fc-d370888be770 tempest-VolumesListAdminTestJSON-775222345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:15:07 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-347bdc5b-0157-49e2-a8fc-d370888be770 tempest-VolumesListAdminTestJSON-775222345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:15:07 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-347bdc5b-0157-49e2-a8fc-d370888be770 tempest-VolumesListAdminTestJSON-775222345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:15:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-347bdc5b-0157-49e2-a8fc-d370888be770 tempest-VolumesListAdminTestJSON-775222345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:15:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-347bdc5b-0157-49e2-a8fc-d370888be770 tempest-VolumesListAdminTestJSON-775222345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:07 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-9892c154-bc13-45c7-9a18-6486cdc89186 tempest-VolumesListAdminTestJSON-775222345 None] Acquiring lock "cinder-9b832e3b-3e9b-44c7-9dd9-9778f4b147ab-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:15:07 devstack sudo[103877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:15:07 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:07 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-d73f60fa-cbee-4325-9522-d117414a904c req-0c139dde-da0c-4ec7-9fad-02880e1e0498 tempest-AttachVolumeNegativeTest-1748370238 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3', 'name': 'volume-63c2dc4b-bd08-4207-95d0-91ff88cb1b5d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03bd3bec-36b8-4036-bbea-bdeef93d21b4', 'enforce_multipath': True} {{(pid=93497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 11:15:07 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-9892c154-bc13-45c7-9a18-6486cdc89186 tempest-VolumesListAdminTestJSON-775222345 None] Lock "cinder-9b832e3b-3e9b-44c7-9dd9-9778f4b147ab-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:15:07 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-9892c154-bc13-45c7-9a18-6486cdc89186 tempest-VolumesListAdminTestJSON-775222345 None] Acquiring lock "cinder-quobyte-9b832e3b-3e9b-44c7-9dd9-9778f4b147ab" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:15:07 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-d73f60fa-cbee-4325-9522-d117414a904c req-0c139dde-da0c-4ec7-9fad-02880e1e0498 tempest-AttachVolumeNegativeTest-1748370238 None] attachment_update completed successfully. Jun 29 11:15:07 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-9892c154-bc13-45c7-9a18-6486cdc89186 tempest-VolumesListAdminTestJSON-775222345 None] Lock "cinder-quobyte-9b832e3b-3e9b-44c7-9dd9-9778f4b147ab" acquired by "delete_volume" :: waited 0.041s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:15:07 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[20aacb23-2cfa-4721-9485-b87fc7cdf13c]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:15:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9892c154-bc13-45c7-9a18-6486cdc89186 tempest-VolumesListAdminTestJSON-775222345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-9b832e3b-3e9b-44c7-9dd9-9778f4b147ab {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:07 devstack sudo[103880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-9b832e3b-3e9b-44c7-9dd9-9778f4b147ab Jun 29 11:15:07 devstack sudo[103880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:08 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:15:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:15:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:15:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:15:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:15:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:15:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:08 devstack sudo[103885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:15:08 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:09 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-30630ec7-a17e-43a9-9f37-a052fa7471ec tempest-VolumesListAdminTestJSON-368112906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 2.127s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:09 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-30630ec7-a17e-43a9-9f37-a052fa7471ec tempest-VolumesListAdminTestJSON-368112906 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:15:09 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-30630ec7-a17e-43a9-9f37-a052fa7471ec tempest-VolumesListAdminTestJSON-368112906 None] Deleted volume successfully. Jun 29 11:15:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-30630ec7-a17e-43a9-9f37-a052fa7471ec tempest-VolumesListAdminTestJSON-368112906 None] Lock "cinder-1b98a2a7-9da4-44bd-823c-ad2226927922-delete_volume" released by "delete_volume" :: held 6.271s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:15:09 devstack sudo[103880]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9892c154-bc13-45c7-9a18-6486cdc89186 tempest-VolumesListAdminTestJSON-775222345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-9b832e3b-3e9b-44c7-9dd9-9778f4b147ab" returned: 0 in 1.976s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9892c154-bc13-45c7-9a18-6486cdc89186 tempest-VolumesListAdminTestJSON-775222345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-9b832e3b-3e9b-44c7-9dd9-9778f4b147ab {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:09 devstack sudo[103900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-9b832e3b-3e9b-44c7-9dd9-9778f4b147ab Jun 29 11:15:09 devstack sudo[103900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:09 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-347bdc5b-0157-49e2-a8fc-d370888be770 tempest-VolumesListAdminTestJSON-775222345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 2.626s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:09 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-347bdc5b-0157-49e2-a8fc-d370888be770 tempest-VolumesListAdminTestJSON-775222345 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:15:09 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-347bdc5b-0157-49e2-a8fc-d370888be770 tempest-VolumesListAdminTestJSON-775222345 None] Deleted volume successfully. Jun 29 11:15:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-347bdc5b-0157-49e2-a8fc-d370888be770 tempest-VolumesListAdminTestJSON-775222345 None] Lock "cinder-ea8b0d88-b70f-4751-9825-a90b676657cb-delete_volume" released by "delete_volume" :: held 6.655s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:15:10 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 2.333s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:10 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:15:10 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager._thread_info {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:15:10 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread count: 28 {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 11:15:10 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread info: [<_MainThread(MainThread, started 131117520400512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 11:15:11 devstack sudo[103900]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9892c154-bc13-45c7-9a18-6486cdc89186 tempest-VolumesListAdminTestJSON-775222345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-9b832e3b-3e9b-44c7-9dd9-9778f4b147ab" returned: 0 in 1.443s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:11 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-9892c154-bc13-45c7-9a18-6486cdc89186 tempest-VolumesListAdminTestJSON-775222345 None] Lock "cinder-quobyte-9b832e3b-3e9b-44c7-9dd9-9778f4b147ab" released by "delete_volume" :: held 3.502s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:15:11 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-9892c154-bc13-45c7-9a18-6486cdc89186 tempest-VolumesListAdminTestJSON-775222345 None] Created reservations ['c94281cc-0fdb-4a82-805d-297873ada8a4', '96f2b186-7614-4998-b211-5ddbb42cc4ea', '2134bbd7-21b7-4b55-a53a-a7fb85c40d37', 'b4848be9-1c3f-440b-a3b8-aaa860d83215'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:15:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9892c154-bc13-45c7-9a18-6486cdc89186 tempest-VolumesListAdminTestJSON-775222345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:15:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9892c154-bc13-45c7-9a18-6486cdc89186 tempest-VolumesListAdminTestJSON-775222345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:15:11 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9892c154-bc13-45c7-9a18-6486cdc89186 tempest-VolumesListAdminTestJSON-775222345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:15:11 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9892c154-bc13-45c7-9a18-6486cdc89186 tempest-VolumesListAdminTestJSON-775222345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:15:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9892c154-bc13-45c7-9a18-6486cdc89186 tempest-VolumesListAdminTestJSON-775222345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:15:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9892c154-bc13-45c7-9a18-6486cdc89186 tempest-VolumesListAdminTestJSON-775222345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:11 devstack sudo[103929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:15:11 devstack sudo[103929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:12 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a4b11b81-06f7-4382-8851-b0deac9b706e tempest-VolumesListAdminTestJSON-775222345 None] Acquiring lock "cinder-d21ce8f7-9752-4f41-ba61-feb8e0cadc18-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:15:12 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a4b11b81-06f7-4382-8851-b0deac9b706e tempest-VolumesListAdminTestJSON-775222345 None] Lock "cinder-d21ce8f7-9752-4f41-ba61-feb8e0cadc18-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:15:12 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a4b11b81-06f7-4382-8851-b0deac9b706e tempest-VolumesListAdminTestJSON-775222345 None] Acquiring lock "cinder-quobyte-d21ce8f7-9752-4f41-ba61-feb8e0cadc18" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:15:12 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a4b11b81-06f7-4382-8851-b0deac9b706e tempest-VolumesListAdminTestJSON-775222345 None] Lock "cinder-quobyte-d21ce8f7-9752-4f41-ba61-feb8e0cadc18" acquired by "delete_volume" :: waited 0.059s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:15:12 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7559e07-7910-4049-8fb3-fb9c8f3ece23]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:15:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a4b11b81-06f7-4382-8851-b0deac9b706e tempest-VolumesListAdminTestJSON-775222345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d21ce8f7-9752-4f41-ba61-feb8e0cadc18 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:12 devstack sudo[103929]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9892c154-bc13-45c7-9a18-6486cdc89186 tempest-VolumesListAdminTestJSON-775222345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.293s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:12 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-9892c154-bc13-45c7-9a18-6486cdc89186 tempest-VolumesListAdminTestJSON-775222345 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:15:12 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-9892c154-bc13-45c7-9a18-6486cdc89186 tempest-VolumesListAdminTestJSON-775222345 None] Deleted volume successfully. Jun 29 11:15:12 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-9892c154-bc13-45c7-9a18-6486cdc89186 tempest-VolumesListAdminTestJSON-775222345 None] Lock "cinder-9b832e3b-3e9b-44c7-9dd9-9778f4b147ab-delete_volume" released by "delete_volume" :: held 5.317s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:15:12 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d21ce8f7-9752-4f41-ba61-feb8e0cadc18 Jun 29 11:15:12 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:13 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a4b11b81-06f7-4382-8851-b0deac9b706e tempest-VolumesListAdminTestJSON-775222345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d21ce8f7-9752-4f41-ba61-feb8e0cadc18" returned: 0 in 1.350s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a4b11b81-06f7-4382-8851-b0deac9b706e tempest-VolumesListAdminTestJSON-775222345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d21ce8f7-9752-4f41-ba61-feb8e0cadc18 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:13 devstack sudo[104014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d21ce8f7-9752-4f41-ba61-feb8e0cadc18 Jun 29 11:15:13 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:14 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a4b11b81-06f7-4382-8851-b0deac9b706e tempest-VolumesListAdminTestJSON-775222345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d21ce8f7-9752-4f41-ba61-feb8e0cadc18" returned: 0 in 0.925s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:14 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a4b11b81-06f7-4382-8851-b0deac9b706e tempest-VolumesListAdminTestJSON-775222345 None] Lock "cinder-quobyte-d21ce8f7-9752-4f41-ba61-feb8e0cadc18" released by "delete_volume" :: held 2.360s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:15:14 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-a4b11b81-06f7-4382-8851-b0deac9b706e tempest-VolumesListAdminTestJSON-775222345 None] Created reservations ['988156fe-9045-4dcf-8bc9-497ddc1a7afa', 'f0f5eaca-17cc-4af0-a9c0-d74d83503448', '7e1e4ff8-2348-4b0c-90c5-9151f74d8513', '4aaddd93-f9e4-4891-9440-7147baee0083'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:15:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a4b11b81-06f7-4382-8851-b0deac9b706e tempest-VolumesListAdminTestJSON-775222345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:15:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a4b11b81-06f7-4382-8851-b0deac9b706e tempest-VolumesListAdminTestJSON-775222345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:15:14 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a4b11b81-06f7-4382-8851-b0deac9b706e tempest-VolumesListAdminTestJSON-775222345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:15:14 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a4b11b81-06f7-4382-8851-b0deac9b706e tempest-VolumesListAdminTestJSON-775222345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:15:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a4b11b81-06f7-4382-8851-b0deac9b706e tempest-VolumesListAdminTestJSON-775222345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:15:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a4b11b81-06f7-4382-8851-b0deac9b706e tempest-VolumesListAdminTestJSON-775222345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:15 devstack sudo[104017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:15:15 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:15 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-3ca346c6-61cd-4c22-885a-17519dc7b633 req-8c69c756-3dd6-4c27-b011-72852281480e tempest-AttachVolumeNegativeTest-1748370238 None] Terminate volume connection completed successfully. Jun 29 11:15:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-3ca346c6-61cd-4c22-885a-17519dc7b633 req-8c69c756-3dd6-4c27-b011-72852281480e tempest-AttachVolumeNegativeTest-1748370238 None] Deleting attachment 03bd3bec-36b8-4036-bbea-bdeef93d21b4. {{(pid=93497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 11:15:15 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a4b11b81-06f7-4382-8851-b0deac9b706e tempest-VolumesListAdminTestJSON-775222345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.776s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:15 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-a4b11b81-06f7-4382-8851-b0deac9b706e tempest-VolumesListAdminTestJSON-775222345 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:15:15 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-a4b11b81-06f7-4382-8851-b0deac9b706e tempest-VolumesListAdminTestJSON-775222345 None] Deleted volume successfully. Jun 29 11:15:15 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a4b11b81-06f7-4382-8851-b0deac9b706e tempest-VolumesListAdminTestJSON-775222345 None] Lock "cinder-d21ce8f7-9752-4f41-ba61-feb8e0cadc18-delete_volume" released by "delete_volume" :: held 3.474s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:15:21 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:15:21 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] Flow 'volume_create_manager' (2b9cf553-d2b6-4d47-822d-152576d5e232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:15:21 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642cd595-31ff-4f2b-9027-312d2d0ecae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:15:21 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642cd595-31ff-4f2b-9027-312d2d0ecae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1611689631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=953706a9-4470-47f0-8464-83ef2cad8b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5d867815bbf48d8ac19da09b4e7286f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:15:21Z,use_quota=True,user_id='ff998d2de65e4b10b2dab2ef1c7d12b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:15:21 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd39007f-f6cc-42d7-a0c3-d7bb1ae5bd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:15:21 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd39007f-f6cc-42d7-a0c3-d7bb1ae5bd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:15:21 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b85e157-8356-4f60-9548-cf940654504c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:15:21 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b85e157-8356-4f60-9548-cf940654504c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '953706a9-4470-47f0-8464-83ef2cad8b2a', 'volume_name': 'volume-953706a9-4470-47f0-8464-83ef2cad8b2a', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:15:21 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18e6f918-483d-4639-9185-bad1c1c91cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:15:21 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18e6f918-483d-4639-9185-bad1c1c91cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:15:21 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae30f522-5b4d-40d7-9388-1caea77964a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:15:21 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] Volume 953706a9-4470-47f0-8464-83ef2cad8b2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-953706a9-4470-47f0-8464-83ef2cad8b2a', 'volume_size': 1} Jun 29 11:15:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:15:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:15:21 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1611689631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=953706a9-4470-47f0-8464-83ef2cad8b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5d867815bbf48d8ac19da09b4e7286f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:15:21Z,use_quota=True,user_id='ff998d2de65e4b10b2dab2ef1c7d12b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:15:21 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] Creating volume 953706a9-4470-47f0-8464-83ef2cad8b2a {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:15:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:15:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:15:21 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:15:21 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:15:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:15:21 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:15:21 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:15:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:21 devstack sudo[104075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a 1073741824 Jun 29 11:15:21 devstack sudo[104075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:22 devstack sudo[104075]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a 1073741824" returned: 0 in 1.183s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:22 devstack sudo[104082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a Jun 29 11:15:22 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:23 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a" returned: 0 in 1.225s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:23 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] <== create_volume: return (2480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:15:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.489s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:15:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae30f522-5b4d-40d7-9388-1caea77964a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-953706a9-4470-47f0-8464-83ef2cad8b2a', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:15:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b14b4f5-0678-4cd3-b597-0098295f7f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:15:23 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] Volume volume-953706a9-4470-47f0-8464-83ef2cad8b2a (953706a9-4470-47f0-8464-83ef2cad8b2a): created successfully Jun 29 11:15:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b14b4f5-0678-4cd3-b597-0098295f7f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:15:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] Flow 'volume_create_manager' (2b9cf553-d2b6-4d47-822d-152576d5e232) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:15:24 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-c3c41849-e680-42e4-9300-44967f2e4aa5 tempest-SnapshotMetadataTestJSON-803119977 None] Created volume successfully. Jun 29 11:15:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-54b76d58-cf2b-4dba-bc76-cd5a929365d4 tempest-SnapshotMetadataTestJSON-803119977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:15:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-54b76d58-cf2b-4dba-bc76-cd5a929365d4 tempest-SnapshotMetadataTestJSON-803119977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:15:24 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-54b76d58-cf2b-4dba-bc76-cd5a929365d4 tempest-SnapshotMetadataTestJSON-803119977 None] Creating offline snapshot 2cdf1c08-5d4b-414e-a9ad-3ddb2099035f of volume 953706a9-4470-47f0-8464-83ef2cad8b2a {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:15:24 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f1a17f-7c17-491f-b793-5135a4f0ce55]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:15:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-54b76d58-cf2b-4dba-bc76-cd5a929365d4 tempest-SnapshotMetadataTestJSON-803119977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:25 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a Jun 29 11:15:25 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:26 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-54b76d58-cf2b-4dba-bc76-cd5a929365d4 tempest-SnapshotMetadataTestJSON-803119977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a" returned: 0 in 1.169s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-54b76d58-cf2b-4dba-bc76-cd5a929365d4 tempest-SnapshotMetadataTestJSON-803119977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a.2cdf1c08-5d4b-414e-a9ad-3ddb2099035f 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:26 devstack sudo[104096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a.2cdf1c08-5d4b-414e-a9ad-3ddb2099035f 1G Jun 29 11:15:26 devstack sudo[104096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:27 devstack sudo[104096]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-54b76d58-cf2b-4dba-bc76-cd5a929365d4 tempest-SnapshotMetadataTestJSON-803119977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a.2cdf1c08-5d4b-414e-a9ad-3ddb2099035f 1G" returned: 0 in 1.181s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-54b76d58-cf2b-4dba-bc76-cd5a929365d4 tempest-SnapshotMetadataTestJSON-803119977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-953706a9-4470-47f0-8464-83ef2cad8b2a -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a.2cdf1c08-5d4b-414e-a9ad-3ddb2099035f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:27 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=54,cinder:INSERT=18,cinder:UPDATE=64,cinder:DELETE=7 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:15:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-6989b42f-a34d-4117-8ebd-48eec8747833 req-50d4893d-eb9d-488f-9698-444bf2eacbfe tempest-TestInstancesWithCinderVolumes-1178480732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:15:27 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-953706a9-4470-47f0-8464-83ef2cad8b2a -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a.2cdf1c08-5d4b-414e-a9ad-3ddb2099035f Jun 29 11:15:27 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:28 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-54b76d58-cf2b-4dba-bc76-cd5a929365d4 tempest-SnapshotMetadataTestJSON-803119977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-953706a9-4470-47f0-8464-83ef2cad8b2a -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a.2cdf1c08-5d4b-414e-a9ad-3ddb2099035f" returned: 0 in 0.845s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:28 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-54b76d58-cf2b-4dba-bc76-cd5a929365d4 tempest-SnapshotMetadataTestJSON-803119977 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a.2cdf1c08-5d4b-414e-a9ad-3ddb2099035f is being set with open permissions: ugo+rw Jun 29 11:15:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-54b76d58-cf2b-4dba-bc76-cd5a929365d4 tempest-SnapshotMetadataTestJSON-803119977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a.2cdf1c08-5d4b-414e-a9ad-3ddb2099035f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:28 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a.2cdf1c08-5d4b-414e-a9ad-3ddb2099035f Jun 29 11:15:28 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:28 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-54b76d58-cf2b-4dba-bc76-cd5a929365d4 tempest-SnapshotMetadataTestJSON-803119977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a.2cdf1c08-5d4b-414e-a9ad-3ddb2099035f" returned: 0 in 0.736s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-54b76d58-cf2b-4dba-bc76-cd5a929365d4 tempest-SnapshotMetadataTestJSON-803119977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:28 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a.info Jun 29 11:15:28 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:29 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-54b76d58-cf2b-4dba-bc76-cd5a929365d4 tempest-SnapshotMetadataTestJSON-803119977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a.info" returned: 0 in 0.643s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:29 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-54b76d58-cf2b-4dba-bc76-cd5a929365d4 tempest-SnapshotMetadataTestJSON-803119977 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a.info is being set with open permissions: ugo+rw Jun 29 11:15:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-54b76d58-cf2b-4dba-bc76-cd5a929365d4 tempest-SnapshotMetadataTestJSON-803119977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:29 devstack sudo[104124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a.info Jun 29 11:15:29 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:30 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-54b76d58-cf2b-4dba-bc76-cd5a929365d4 tempest-SnapshotMetadataTestJSON-803119977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a.info" returned: 0 in 0.650s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-54b76d58-cf2b-4dba-bc76-cd5a929365d4 tempest-SnapshotMetadataTestJSON-803119977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.368s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:15:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-6989b42f-a34d-4117-8ebd-48eec8747833 req-50d4893d-eb9d-488f-9698-444bf2eacbfe tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.921s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:15:30 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92e9890-c887-4502-a609-5ff46e6419be]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:15:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-6989b42f-a34d-4117-8ebd-48eec8747833 req-50d4893d-eb9d-488f-9698-444bf2eacbfe tempest-TestInstancesWithCinderVolumes-1178480732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e5288846-be83-488e-90c0-87d4e34c925c {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:30 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-54b76d58-cf2b-4dba-bc76-cd5a929365d4 tempest-SnapshotMetadataTestJSON-803119977 None] Create snapshot completed successfully Jun 29 11:15:30 devstack sudo[104127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e5288846-be83-488e-90c0-87d4e34c925c Jun 29 11:15:30 devstack sudo[104127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:31 devstack sudo[104127]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-6989b42f-a34d-4117-8ebd-48eec8747833 req-50d4893d-eb9d-488f-9698-444bf2eacbfe tempest-TestInstancesWithCinderVolumes-1178480732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e5288846-be83-488e-90c0-87d4e34c925c" returned: 0 in 0.899s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-6989b42f-a34d-4117-8ebd-48eec8747833 req-50d4893d-eb9d-488f-9698-444bf2eacbfe tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.920s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:15:31 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-6989b42f-a34d-4117-8ebd-48eec8747833 req-50d4893d-eb9d-488f-9698-444bf2eacbfe tempest-TestInstancesWithCinderVolumes-1178480732 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3', 'name': 'volume-e5288846-be83-488e-90c0-87d4e34c925c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32eb13f4-d06c-40e8-976f-f7f3bf07a2fa', 'enforce_multipath': True} {{(pid=93497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 11:15:31 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-6989b42f-a34d-4117-8ebd-48eec8747833 req-50d4893d-eb9d-488f-9698-444bf2eacbfe tempest-TestInstancesWithCinderVolumes-1178480732 None] attachment_update completed successfully. Jun 29 11:15:31 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-503895f1-6099-4d6f-bdac-07c190d57f01 tempest-SnapshotMetadataTestJSON-803119977 None] Acquiring lock "cinder-2cdf1c08-5d4b-414e-a9ad-3ddb2099035f-delete_snapshot" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:15:31 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-503895f1-6099-4d6f-bdac-07c190d57f01 tempest-SnapshotMetadataTestJSON-803119977 None] Lock "cinder-2cdf1c08-5d4b-414e-a9ad-3ddb2099035f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:15:31 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-503895f1-6099-4d6f-bdac-07c190d57f01 tempest-SnapshotMetadataTestJSON-803119977 None] Acquiring lock "cinder-quobyte-953706a9-4470-47f0-8464-83ef2cad8b2a" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:15:31 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-503895f1-6099-4d6f-bdac-07c190d57f01 tempest-SnapshotMetadataTestJSON-803119977 None] Lock "cinder-quobyte-953706a9-4470-47f0-8464-83ef2cad8b2a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:15:31 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-503895f1-6099-4d6f-bdac-07c190d57f01 tempest-SnapshotMetadataTestJSON-803119977 None] Acquiring lock "cinder-quobyte-2cdf1c08-5d4b-414e-a9ad-3ddb2099035f" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:15:31 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-503895f1-6099-4d6f-bdac-07c190d57f01 tempest-SnapshotMetadataTestJSON-803119977 None] Lock "cinder-quobyte-2cdf1c08-5d4b-414e-a9ad-3ddb2099035f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:15:31 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-503895f1-6099-4d6f-bdac-07c190d57f01 tempest-SnapshotMetadataTestJSON-803119977 None] Deleting offline snapshot 2cdf1c08-5d4b-414e-a9ad-3ddb2099035f of volume 953706a9-4470-47f0-8464-83ef2cad8b2a {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:15:31 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-503895f1-6099-4d6f-bdac-07c190d57f01 tempest-SnapshotMetadataTestJSON-803119977 None] snapshot_file for this snap is: volume-953706a9-4470-47f0-8464-83ef2cad8b2a.2cdf1c08-5d4b-414e-a9ad-3ddb2099035f {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:15:31 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b19a90-8bc8-4876-b94c-d5e749b6b9e1]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:15:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-503895f1-6099-4d6f-bdac-07c190d57f01 tempest-SnapshotMetadataTestJSON-803119977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a.2cdf1c08-5d4b-414e-a9ad-3ddb2099035f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:32 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a.2cdf1c08-5d4b-414e-a9ad-3ddb2099035f Jun 29 11:15:32 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:32 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-503895f1-6099-4d6f-bdac-07c190d57f01 tempest-SnapshotMetadataTestJSON-803119977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a.2cdf1c08-5d4b-414e-a9ad-3ddb2099035f" returned: 0 in 0.851s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:32 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-503895f1-6099-4d6f-bdac-07c190d57f01 tempest-SnapshotMetadataTestJSON-803119977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-953706a9-4470-47f0-8464-83ef2cad8b2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:15:32 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c999fb-3d81-483f-9292-0c9a551f26b1]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:15:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-503895f1-6099-4d6f-bdac-07c190d57f01 tempest-SnapshotMetadataTestJSON-803119977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:32 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a Jun 29 11:15:32 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:33 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-503895f1-6099-4d6f-bdac-07c190d57f01 tempest-SnapshotMetadataTestJSON-803119977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a" returned: 0 in 0.929s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-503895f1-6099-4d6f-bdac-07c190d57f01 tempest-SnapshotMetadataTestJSON-803119977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a.2cdf1c08-5d4b-414e-a9ad-3ddb2099035f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:33 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a.2cdf1c08-5d4b-414e-a9ad-3ddb2099035f Jun 29 11:15:33 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:34 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-503895f1-6099-4d6f-bdac-07c190d57f01 tempest-SnapshotMetadataTestJSON-803119977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a.2cdf1c08-5d4b-414e-a9ad-3ddb2099035f" returned: 0 in 0.820s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-503895f1-6099-4d6f-bdac-07c190d57f01 tempest-SnapshotMetadataTestJSON-803119977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a.2cdf1c08-5d4b-414e-a9ad-3ddb2099035f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:34 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a.2cdf1c08-5d4b-414e-a9ad-3ddb2099035f Jun 29 11:15:34 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:35 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-503895f1-6099-4d6f-bdac-07c190d57f01 tempest-SnapshotMetadataTestJSON-803119977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a.2cdf1c08-5d4b-414e-a9ad-3ddb2099035f" returned: 0 in 0.819s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:35 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-503895f1-6099-4d6f-bdac-07c190d57f01 tempest-SnapshotMetadataTestJSON-803119977 None] Lock "cinder-quobyte-2cdf1c08-5d4b-414e-a9ad-3ddb2099035f" released by "_delete_snapshot" :: held 3.566s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:15:35 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-503895f1-6099-4d6f-bdac-07c190d57f01 tempest-SnapshotMetadataTestJSON-803119977 None] Lock "cinder-quobyte-953706a9-4470-47f0-8464-83ef2cad8b2a" released by "delete_snapshot" :: held 3.590s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:15:35 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-503895f1-6099-4d6f-bdac-07c190d57f01 tempest-SnapshotMetadataTestJSON-803119977 None] Created reservations ['657d2a7f-c138-4a46-a31e-d3384cc4f701', '55265c55-6bdd-4c7a-8525-e3bc94b85a96', '8609c883-cc3b-4b75-a1cd-2709dd6f61b8', '98516519-e977-4e7d-b50b-960b2aaa5223'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:15:35 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-503895f1-6099-4d6f-bdac-07c190d57f01 tempest-SnapshotMetadataTestJSON-803119977 None] Delete snapshot completed successfully. Jun 29 11:15:35 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-503895f1-6099-4d6f-bdac-07c190d57f01 tempest-SnapshotMetadataTestJSON-803119977 None] Lock "cinder-2cdf1c08-5d4b-414e-a9ad-3ddb2099035f-delete_snapshot" released by "delete_snapshot" :: held 3.734s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:15:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e2421156-ef53-4c60-9efd-911df02ab70f tempest-SnapshotMetadataTestJSON-803119977 None] Acquiring lock "cinder-953706a9-4470-47f0-8464-83ef2cad8b2a-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:15:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e2421156-ef53-4c60-9efd-911df02ab70f tempest-SnapshotMetadataTestJSON-803119977 None] Lock "cinder-953706a9-4470-47f0-8464-83ef2cad8b2a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:15:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e2421156-ef53-4c60-9efd-911df02ab70f tempest-SnapshotMetadataTestJSON-803119977 None] Acquiring lock "cinder-quobyte-953706a9-4470-47f0-8464-83ef2cad8b2a" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:15:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e2421156-ef53-4c60-9efd-911df02ab70f tempest-SnapshotMetadataTestJSON-803119977 None] Lock "cinder-quobyte-953706a9-4470-47f0-8464-83ef2cad8b2a" acquired by "delete_volume" :: waited 0.027s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:15:36 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3037be4a-d653-4e0b-88d5-3ca06a56f635]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:15:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e2421156-ef53-4c60-9efd-911df02ab70f tempest-SnapshotMetadataTestJSON-803119977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:36 devstack sudo[104176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a Jun 29 11:15:36 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:37 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e2421156-ef53-4c60-9efd-911df02ab70f tempest-SnapshotMetadataTestJSON-803119977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a" returned: 0 in 0.996s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e2421156-ef53-4c60-9efd-911df02ab70f tempest-SnapshotMetadataTestJSON-803119977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:37 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a Jun 29 11:15:37 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:38 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e2421156-ef53-4c60-9efd-911df02ab70f tempest-SnapshotMetadataTestJSON-803119977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-953706a9-4470-47f0-8464-83ef2cad8b2a" returned: 0 in 0.735s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:38 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e2421156-ef53-4c60-9efd-911df02ab70f tempest-SnapshotMetadataTestJSON-803119977 None] Lock "cinder-quobyte-953706a9-4470-47f0-8464-83ef2cad8b2a" released by "delete_volume" :: held 1.812s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:15:38 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:UPDATE=61,cinder:SELECT=65,cinder:INSERT=17,cinder:DELETE=6 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:15:38 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-e2421156-ef53-4c60-9efd-911df02ab70f tempest-SnapshotMetadataTestJSON-803119977 None] Created reservations ['0a77be0a-d400-4a62-8091-6b0a13a624c2', '6bd1d3c2-fe42-45e9-8252-169b69c7bcc7', 'd123a663-8e29-4b5a-afc9-5189105278a4', '086e092d-c77a-48a2-ad36-57ccc12d113c'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:15:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e2421156-ef53-4c60-9efd-911df02ab70f tempest-SnapshotMetadataTestJSON-803119977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:15:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e2421156-ef53-4c60-9efd-911df02ab70f tempest-SnapshotMetadataTestJSON-803119977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:15:38 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-e2421156-ef53-4c60-9efd-911df02ab70f tempest-SnapshotMetadataTestJSON-803119977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:15:38 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-e2421156-ef53-4c60-9efd-911df02ab70f tempest-SnapshotMetadataTestJSON-803119977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:15:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e2421156-ef53-4c60-9efd-911df02ab70f tempest-SnapshotMetadataTestJSON-803119977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:15:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e2421156-ef53-4c60-9efd-911df02ab70f tempest-SnapshotMetadataTestJSON-803119977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:38 devstack sudo[104204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:15:38 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:38 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e2421156-ef53-4c60-9efd-911df02ab70f tempest-SnapshotMetadataTestJSON-803119977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.714s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:39 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-e2421156-ef53-4c60-9efd-911df02ab70f tempest-SnapshotMetadataTestJSON-803119977 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:15:39 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-e2421156-ef53-4c60-9efd-911df02ab70f tempest-SnapshotMetadataTestJSON-803119977 None] Deleted volume successfully. Jun 29 11:15:39 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e2421156-ef53-4c60-9efd-911df02ab70f tempest-SnapshotMetadataTestJSON-803119977 None] Lock "cinder-953706a9-4470-47f0-8464-83ef2cad8b2a-delete_volume" released by "delete_volume" :: held 2.804s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:15:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-ebd3971d-b43f-4414-b83a-b6b75c95ecba req-9f5db19d-06fd-46a1-bbc2-68454888b967 tempest-TestInstancesWithCinderVolumes-1178480732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:15:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-ebd3971d-b43f-4414-b83a-b6b75c95ecba req-9f5db19d-06fd-46a1-bbc2-68454888b967 tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:15:39 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abc3d1a-5d6f-4204-9511-8757e930c3de]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:15:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-ebd3971d-b43f-4414-b83a-b6b75c95ecba req-9f5db19d-06fd-46a1-bbc2-68454888b967 tempest-TestInstancesWithCinderVolumes-1178480732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d9f314df-b0e7-485a-96b7-6a80486b86f3 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:39 devstack sudo[104219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d9f314df-b0e7-485a-96b7-6a80486b86f3 Jun 29 11:15:39 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:40 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-ebd3971d-b43f-4414-b83a-b6b75c95ecba req-9f5db19d-06fd-46a1-bbc2-68454888b967 tempest-TestInstancesWithCinderVolumes-1178480732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d9f314df-b0e7-485a-96b7-6a80486b86f3" returned: 0 in 0.960s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-ebd3971d-b43f-4414-b83a-b6b75c95ecba req-9f5db19d-06fd-46a1-bbc2-68454888b967 tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.986s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:15:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-ebd3971d-b43f-4414-b83a-b6b75c95ecba req-9f5db19d-06fd-46a1-bbc2-68454888b967 tempest-TestInstancesWithCinderVolumes-1178480732 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3', 'name': 'volume-d9f314df-b0e7-485a-96b7-6a80486b86f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '85907bd9-5012-44bf-b2cc-ba741b362bea', 'enforce_multipath': True} {{(pid=93497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 11:15:40 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-ebd3971d-b43f-4414-b83a-b6b75c95ecba req-9f5db19d-06fd-46a1-bbc2-68454888b967 tempest-TestInstancesWithCinderVolumes-1178480732 None] attachment_update completed successfully. Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] Flow 'volume_create_manager' (1f55dc22-1972-4681-8a28-37cc292e6998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc2a36ad-9dbe-407d-ad73-7a6227368ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc2a36ad-9dbe-407d-ad73-7a6227368ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1120379611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ad8565-57db-4899-bd45-304d78be49e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4661f8719a84d649e627bc24cce04ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:15:47Z,use_quota=True,user_id='92b22b12f23e4c6fb93da99ac422fce5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (585b4b1e-1681-4bf8-a4ba-cd69409c6afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (585b4b1e-1681-4bf8-a4ba-cd69409c6afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2f62fc-21b4-4f91-b8af-e6894bdc6e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2f62fc-21b4-4f91-b8af-e6894bdc6e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3ad8565-57db-4899-bd45-304d78be49e7', 'volume_name': 'volume-a3ad8565-57db-4899-bd45-304d78be49e7', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (886ca2e6-3cec-4429-994d-36cc8ad0d38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (886ca2e6-3cec-4429-994d-36cc8ad0d38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ea1bbd-301e-418f-8172-a90764ad9b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:15:47 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] Volume a3ad8565-57db-4899-bd45-304d78be49e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3ad8565-57db-4899-bd45-304d78be49e7', 'volume_size': 1} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1120379611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ad8565-57db-4899-bd45-304d78be49e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4661f8719a84d649e627bc24cce04ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:15:47Z,use_quota=True,user_id='92b22b12f23e4c6fb93da99ac422fce5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] Creating volume a3ad8565-57db-4899-bd45-304d78be49e7 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:15:47 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a3ad8565-57db-4899-bd45-304d78be49e7 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:47 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a3ad8565-57db-4899-bd45-304d78be49e7 1073741824 Jun 29 11:15:47 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] Flow 'volume_create_manager' (37ec7946-a642-43a5-b6ed-101d7c75ca2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d4298b5-a122-4bca-8313-4cd184a2ec24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d4298b5-a122-4bca-8313-4cd184a2ec24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-422458760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e74809-b8e8-4e61-a012-fe893a01accf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15cabecd4a8e4f52b68e6dd8fef3cc36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:15:47Z,use_quota=True,user_id='51f54a5ba7d24f3bb8d23838e2d88e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53329f83-294b-4a4c-b46a-7f1414d2ebd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53329f83-294b-4a4c-b46a-7f1414d2ebd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f373ca-d8eb-4594-a5da-36907b75207a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f373ca-d8eb-4594-a5da-36907b75207a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0e74809-b8e8-4e61-a012-fe893a01accf', 'volume_name': 'volume-e0e74809-b8e8-4e61-a012-fe893a01accf', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00657e79-cb76-4ed5-8a43-6d9ed8008e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00657e79-cb76-4ed5-8a43-6d9ed8008e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3af6a25e-d68f-4e30-aa42-2c369997a0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:15:47 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] Volume e0e74809-b8e8-4e61-a012-fe893a01accf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0e74809-b8e8-4e61-a012-fe893a01accf', 'volume_size': 1} Jun 29 11:15:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:15:48 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a3ad8565-57db-4899-bd45-304d78be49e7 1073741824" returned: 0 in 1.341s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a3ad8565-57db-4899-bd45-304d78be49e7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:48 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a3ad8565-57db-4899-bd45-304d78be49e7 Jun 29 11:15:48 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:50 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a3ad8565-57db-4899-bd45-304d78be49e7" returned: 0 in 1.451s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] <== create_volume: return (2853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:15:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.868s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:15:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.683s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:15:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-422458760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e74809-b8e8-4e61-a012-fe893a01accf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15cabecd4a8e4f52b68e6dd8fef3cc36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:15:47Z,use_quota=True,user_id='51f54a5ba7d24f3bb8d23838e2d88e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:15:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] Creating volume e0e74809-b8e8-4e61-a012-fe893a01accf {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:15:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:15:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:15:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:15:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:15:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:15:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:15:50 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:15:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0e74809-b8e8-4e61-a012-fe893a01accf 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:50 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0e74809-b8e8-4e61-a012-fe893a01accf 1073741824 Jun 29 11:15:50 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ea1bbd-301e-418f-8172-a90764ad9b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3ad8565-57db-4899-bd45-304d78be49e7', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:15:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2bcb10c-7b9f-4a91-ac63-4c797bf1520b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:15:50 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] Volume volume-a3ad8565-57db-4899-bd45-304d78be49e7 (a3ad8565-57db-4899-bd45-304d78be49e7): created successfully Jun 29 11:15:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2bcb10c-7b9f-4a91-ac63-4c797bf1520b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:15:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] Flow 'volume_create_manager' (1f55dc22-1972-4681-8a28-37cc292e6998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:15:50 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-1efb7148-bf98-43b1-8388-ba8fd76d1c22 tempest-VolumesActionsTest-138828446 None] Created volume successfully. Jun 29 11:15:51 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-7bff9a01-d8da-42e3-9aea-fcbb04fedbd1 tempest-VolumesActionsTest-138828446 None] Acquiring lock "cinder-a3ad8565-57db-4899-bd45-304d78be49e7" by "attach_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:15:51 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-7bff9a01-d8da-42e3-9aea-fcbb04fedbd1 tempest-VolumesActionsTest-138828446 None] Lock "cinder-a3ad8565-57db-4899-bd45-304d78be49e7" acquired by "attach_volume" :: waited 0.046s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:15:51 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-7bff9a01-d8da-42e3-9aea-fcbb04fedbd1 tempest-VolumesActionsTest-138828446 None] Attaching volume a3ad8565-57db-4899-bd45-304d78be49e7 to instance 221418ad-6144-40ee-ab79-2e41ff1b05b2 at mountpoint /dev/vdb on host None. Jun 29 11:15:51 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-7bff9a01-d8da-42e3-9aea-fcbb04fedbd1 tempest-VolumesActionsTest-138828446 None] Attach volume completed successfully. Jun 29 11:15:51 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-7bff9a01-d8da-42e3-9aea-fcbb04fedbd1 tempest-VolumesActionsTest-138828446 None] Lock "cinder-a3ad8565-57db-4899-bd45-304d78be49e7" released by "attach_volume" :: held 0.190s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:15:51 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0e74809-b8e8-4e61-a012-fe893a01accf 1073741824" returned: 0 in 1.573s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0e74809-b8e8-4e61-a012-fe893a01accf {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:51 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0e74809-b8e8-4e61-a012-fe893a01accf Jun 29 11:15:51 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:52 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0e74809-b8e8-4e61-a012-fe893a01accf" returned: 0 in 0.845s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:52 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] <== create_volume: return (2481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:15:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.486s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:15:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3af6a25e-d68f-4e30-aa42-2c369997a0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0e74809-b8e8-4e61-a012-fe893a01accf', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:15:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c293abf5-a9d6-4caa-91ea-fb1e2f08bcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:15:52 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] Volume volume-e0e74809-b8e8-4e61-a012-fe893a01accf (e0e74809-b8e8-4e61-a012-fe893a01accf): created successfully Jun 29 11:15:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c293abf5-a9d6-4caa-91ea-fb1e2f08bcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:15:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] Flow 'volume_create_manager' (37ec7946-a642-43a5-b6ed-101d7c75ca2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:15:52 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-3615f56a-5060-4b28-bf8b-256667cc6d1f tempest-VolumesMetadataTest-899789289 None] Created volume successfully. Jun 29 11:15:53 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-1dfa7f81-62c7-4ad7-804a-a42a6a1beb70 tempest-VolumesActionsTest-731361052 None] Terminate volume connection completed successfully. Jun 29 11:15:53 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-dc949f82-6b9d-49d4-a799-139160768327 req-3460869c-2190-4e9e-ab65-d0d3f31a3291 tempest-TestInstancesWithCinderVolumes-1178480732 None] Terminate volume connection completed successfully. Jun 29 11:15:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-dc949f82-6b9d-49d4-a799-139160768327 req-3460869c-2190-4e9e-ab65-d0d3f31a3291 tempest-TestInstancesWithCinderVolumes-1178480732 None] Deleting attachment 32eb13f4-d06c-40e8-976f-f7f3bf07a2fa. {{(pid=93497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 11:15:53 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1dfa7f81-62c7-4ad7-804a-a42a6a1beb70 tempest-VolumesActionsTest-731361052 None] Acquiring lock "cinder-a3ad8565-57db-4899-bd45-304d78be49e7-detach_volume" by "detach_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:15:53 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1dfa7f81-62c7-4ad7-804a-a42a6a1beb70 tempest-VolumesActionsTest-731361052 None] Lock "cinder-a3ad8565-57db-4899-bd45-304d78be49e7-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:15:53 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-1dfa7f81-62c7-4ad7-804a-a42a6a1beb70 tempest-VolumesActionsTest-731361052 None] Detaching volume a3ad8565-57db-4899-bd45-304d78be49e7 from instance 221418ad-6144-40ee-ab79-2e41ff1b05b2. Jun 29 11:15:53 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-1dfa7f81-62c7-4ad7-804a-a42a6a1beb70 tempest-VolumesActionsTest-731361052 None] Detach volume completed successfully. Jun 29 11:15:53 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1dfa7f81-62c7-4ad7-804a-a42a6a1beb70 tempest-VolumesActionsTest-731361052 None] Lock "cinder-a3ad8565-57db-4899-bd45-304d78be49e7-detach_volume" released by "detach_volume" :: held 0.078s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:15:54 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-91e78e59-ec39-4707-86f6-e96cc7d0d213 tempest-VolumesActionsTest-138828446 None] Acquiring lock "cinder-a3ad8565-57db-4899-bd45-304d78be49e7-detach_volume" by "detach_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:15:54 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-91e78e59-ec39-4707-86f6-e96cc7d0d213 tempest-VolumesActionsTest-138828446 None] Lock "cinder-a3ad8565-57db-4899-bd45-304d78be49e7-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:15:54 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-91e78e59-ec39-4707-86f6-e96cc7d0d213 tempest-VolumesActionsTest-138828446 None] Volume detach called, but volume not attached. Jun 29 11:15:54 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-91e78e59-ec39-4707-86f6-e96cc7d0d213 tempest-VolumesActionsTest-138828446 None] Lock "cinder-a3ad8565-57db-4899-bd45-304d78be49e7-detach_volume" released by "detach_volume" :: held 0.032s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:15:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2289266a-e4e3-46cf-8571-a650cc3f8d7a tempest-VolumesMetadataTest-899789289 None] Acquiring lock "cinder-e0e74809-b8e8-4e61-a012-fe893a01accf-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:15:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2289266a-e4e3-46cf-8571-a650cc3f8d7a tempest-VolumesMetadataTest-899789289 None] Lock "cinder-e0e74809-b8e8-4e61-a012-fe893a01accf-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:15:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-521f2c27-ac2a-4ff7-b5e6-f4020bdeb3f1 tempest-VolumesActionsTest-138828446 None] Acquiring lock "cinder-a3ad8565-57db-4899-bd45-304d78be49e7-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:15:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-521f2c27-ac2a-4ff7-b5e6-f4020bdeb3f1 tempest-VolumesActionsTest-138828446 None] Lock "cinder-a3ad8565-57db-4899-bd45-304d78be49e7-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:15:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2289266a-e4e3-46cf-8571-a650cc3f8d7a tempest-VolumesMetadataTest-899789289 None] Acquiring lock "cinder-quobyte-e0e74809-b8e8-4e61-a012-fe893a01accf" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:15:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2289266a-e4e3-46cf-8571-a650cc3f8d7a tempest-VolumesMetadataTest-899789289 None] Lock "cinder-quobyte-e0e74809-b8e8-4e61-a012-fe893a01accf" acquired by "delete_volume" :: waited 0.023s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:15:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-521f2c27-ac2a-4ff7-b5e6-f4020bdeb3f1 tempest-VolumesActionsTest-138828446 None] Acquiring lock "cinder-quobyte-a3ad8565-57db-4899-bd45-304d78be49e7" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:15:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-521f2c27-ac2a-4ff7-b5e6-f4020bdeb3f1 tempest-VolumesActionsTest-138828446 None] Lock "cinder-quobyte-a3ad8565-57db-4899-bd45-304d78be49e7" acquired by "delete_volume" :: waited 0.023s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:15:55 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeedb66c-350a-4afd-941d-8669ac8fde3c]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:15:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2289266a-e4e3-46cf-8571-a650cc3f8d7a tempest-VolumesMetadataTest-899789289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0e74809-b8e8-4e61-a012-fe893a01accf {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:55 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39a5547-72d3-4e97-b6f5-a8627938dda3]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:15:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-521f2c27-ac2a-4ff7-b5e6-f4020bdeb3f1 tempest-VolumesActionsTest-138828446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a3ad8565-57db-4899-bd45-304d78be49e7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d019efef-27c5-4811-a145-655b2567b860 tempest-TestInstancesWithCinderVolumes-1178480732 None] Acquiring lock "cinder-e5288846-be83-488e-90c0-87d4e34c925c-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:15:55 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0e74809-b8e8-4e61-a012-fe893a01accf Jun 29 11:15:55 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d019efef-27c5-4811-a145-655b2567b860 tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "cinder-e5288846-be83-488e-90c0-87d4e34c925c-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:15:55 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a3ad8565-57db-4899-bd45-304d78be49e7 Jun 29 11:15:55 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d019efef-27c5-4811-a145-655b2567b860 tempest-TestInstancesWithCinderVolumes-1178480732 None] Acquiring lock "cinder-quobyte-e5288846-be83-488e-90c0-87d4e34c925c" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:15:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d019efef-27c5-4811-a145-655b2567b860 tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "cinder-quobyte-e5288846-be83-488e-90c0-87d4e34c925c" acquired by "delete_volume" :: waited 0.027s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:15:55 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5339f88-600c-461d-9c9b-feec2fd0e04d]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:15:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d019efef-27c5-4811-a145-655b2567b860 tempest-TestInstancesWithCinderVolumes-1178480732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e5288846-be83-488e-90c0-87d4e34c925c {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:55 devstack sudo[104489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e5288846-be83-488e-90c0-87d4e34c925c Jun 29 11:15:55 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:56 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-521f2c27-ac2a-4ff7-b5e6-f4020bdeb3f1 tempest-VolumesActionsTest-138828446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a3ad8565-57db-4899-bd45-304d78be49e7" returned: 0 in 1.532s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-521f2c27-ac2a-4ff7-b5e6-f4020bdeb3f1 tempest-VolumesActionsTest-138828446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a3ad8565-57db-4899-bd45-304d78be49e7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:56 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2289266a-e4e3-46cf-8571-a650cc3f8d7a tempest-VolumesMetadataTest-899789289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0e74809-b8e8-4e61-a012-fe893a01accf" returned: 0 in 1.571s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2289266a-e4e3-46cf-8571-a650cc3f8d7a tempest-VolumesMetadataTest-899789289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0e74809-b8e8-4e61-a012-fe893a01accf {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:56 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a3ad8565-57db-4899-bd45-304d78be49e7 Jun 29 11:15:57 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:57 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0e74809-b8e8-4e61-a012-fe893a01accf Jun 29 11:15:57 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:57 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d019efef-27c5-4811-a145-655b2567b860 tempest-TestInstancesWithCinderVolumes-1178480732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e5288846-be83-488e-90c0-87d4e34c925c" returned: 0 in 1.325s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d019efef-27c5-4811-a145-655b2567b860 tempest-TestInstancesWithCinderVolumes-1178480732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e5288846-be83-488e-90c0-87d4e34c925c {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:57 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e5288846-be83-488e-90c0-87d4e34c925c Jun 29 11:15:57 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:58 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d019efef-27c5-4811-a145-655b2567b860 tempest-TestInstancesWithCinderVolumes-1178480732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e5288846-be83-488e-90c0-87d4e34c925c" returned: 0 in 1.100s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:58 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d019efef-27c5-4811-a145-655b2567b860 tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "cinder-quobyte-e5288846-be83-488e-90c0-87d4e34c925c" released by "delete_volume" :: held 2.497s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:15:58 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-521f2c27-ac2a-4ff7-b5e6-f4020bdeb3f1 tempest-VolumesActionsTest-138828446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a3ad8565-57db-4899-bd45-304d78be49e7" returned: 0 in 1.303s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:58 devstack cinder-volume[93497]: WARNING cinder.quota [None req-d019efef-27c5-4811-a145-655b2567b860 tempest-TestInstancesWithCinderVolumes-1178480732 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1947117536-1802986420 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1947117536-1802986420, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:15:58 devstack cinder-volume[93497]: WARNING cinder.quota [None req-d019efef-27c5-4811-a145-655b2567b860 tempest-TestInstancesWithCinderVolumes-1178480732 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1947117536-1802986420 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1947117536-1802986420, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:15:58 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Jun 29 11:15:58 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-521f2c27-ac2a-4ff7-b5e6-f4020bdeb3f1 tempest-VolumesActionsTest-138828446 None] Lock "cinder-quobyte-a3ad8565-57db-4899-bd45-304d78be49e7" released by "delete_volume" :: held 2.915s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:15:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2289266a-e4e3-46cf-8571-a650cc3f8d7a tempest-VolumesMetadataTest-899789289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0e74809-b8e8-4e61-a012-fe893a01accf" returned: 0 in 1.316s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:15:58 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2289266a-e4e3-46cf-8571-a650cc3f8d7a tempest-VolumesMetadataTest-899789289 None] Lock "cinder-quobyte-e0e74809-b8e8-4e61-a012-fe893a01accf" released by "delete_volume" :: held 2.995s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:15:58 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-d019efef-27c5-4811-a145-655b2567b860 tempest-TestInstancesWithCinderVolumes-1178480732 None] Created reservations ['35ef721d-de46-4f53-a8de-e0762052a222', '640fd04d-af78-4284-a056-f9b819deb186', '7890676e-b1d2-4395-9858-e7244c79168e', 'e24cc1dc-6600-4b9c-9fe6-86d4debecd9a'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:15:58 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-521f2c27-ac2a-4ff7-b5e6-f4020bdeb3f1 tempest-VolumesActionsTest-138828446 None] Created reservations ['f1c5779e-902a-449c-ac41-6527a21d3692', 'd0642383-06ac-4365-b846-fd720cc3ce34', '98825092-b16d-4ccb-aa6d-2b91ac75e29c', '2ed53a10-269c-4e35-8b4e-2859262a9062'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:15:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d019efef-27c5-4811-a145-655b2567b860 tempest-TestInstancesWithCinderVolumes-1178480732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:15:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d019efef-27c5-4811-a145-655b2567b860 tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:15:58 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d019efef-27c5-4811-a145-655b2567b860 tempest-TestInstancesWithCinderVolumes-1178480732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:15:58 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d019efef-27c5-4811-a145-655b2567b860 tempest-TestInstancesWithCinderVolumes-1178480732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:15:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d019efef-27c5-4811-a145-655b2567b860 tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:15:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d019efef-27c5-4811-a145-655b2567b860 tempest-TestInstancesWithCinderVolumes-1178480732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:58 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-2289266a-e4e3-46cf-8571-a650cc3f8d7a tempest-VolumesMetadataTest-899789289 None] Created reservations ['8e91c0cb-fb4d-477c-b127-5ce97da8a8a9', '21735349-288f-42a0-aa28-9401c27597b7', '6dd7a59d-9530-4398-a30b-ecad936718bf', '4c0aa38a-67e2-49c2-adc4-7a780bc72220'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:15:58 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:15:58 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-521f2c27-ac2a-4ff7-b5e6-f4020bdeb3f1 tempest-VolumesActionsTest-138828446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:15:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-521f2c27-ac2a-4ff7-b5e6-f4020bdeb3f1 tempest-VolumesActionsTest-138828446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:15:58 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-521f2c27-ac2a-4ff7-b5e6-f4020bdeb3f1 tempest-VolumesActionsTest-138828446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:15:58 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-521f2c27-ac2a-4ff7-b5e6-f4020bdeb3f1 tempest-VolumesActionsTest-138828446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:15:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-521f2c27-ac2a-4ff7-b5e6-f4020bdeb3f1 tempest-VolumesActionsTest-138828446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:15:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-521f2c27-ac2a-4ff7-b5e6-f4020bdeb3f1 tempest-VolumesActionsTest-138828446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:58 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:15:58 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:15:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2289266a-e4e3-46cf-8571-a650cc3f8d7a tempest-VolumesMetadataTest-899789289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:15:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2289266a-e4e3-46cf-8571-a650cc3f8d7a tempest-VolumesMetadataTest-899789289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:15:58 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2289266a-e4e3-46cf-8571-a650cc3f8d7a tempest-VolumesMetadataTest-899789289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:15:58 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2289266a-e4e3-46cf-8571-a650cc3f8d7a tempest-VolumesMetadataTest-899789289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:15:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2289266a-e4e3-46cf-8571-a650cc3f8d7a tempest-VolumesMetadataTest-899789289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:15:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2289266a-e4e3-46cf-8571-a650cc3f8d7a tempest-VolumesMetadataTest-899789289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:15:58 devstack sudo[104561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:15:58 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:00 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:00 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d019efef-27c5-4811-a145-655b2567b860 tempest-TestInstancesWithCinderVolumes-1178480732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.725s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:00 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-d019efef-27c5-4811-a145-655b2567b860 tempest-TestInstancesWithCinderVolumes-1178480732 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:16:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-521f2c27-ac2a-4ff7-b5e6-f4020bdeb3f1 tempest-VolumesActionsTest-138828446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.675s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:00 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-521f2c27-ac2a-4ff7-b5e6-f4020bdeb3f1 tempest-VolumesActionsTest-138828446 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:16:00 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-d019efef-27c5-4811-a145-655b2567b860 tempest-TestInstancesWithCinderVolumes-1178480732 None] Deleted volume successfully. Jun 29 11:16:00 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d019efef-27c5-4811-a145-655b2567b860 tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "cinder-e5288846-be83-488e-90c0-87d4e34c925c-delete_volume" released by "delete_volume" :: held 4.817s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:00 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-521f2c27-ac2a-4ff7-b5e6-f4020bdeb3f1 tempest-VolumesActionsTest-138828446 None] Deleted volume successfully. Jun 29 11:16:00 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-521f2c27-ac2a-4ff7-b5e6-f4020bdeb3f1 tempest-VolumesActionsTest-138828446 None] Lock "cinder-a3ad8565-57db-4899-bd45-304d78be49e7-delete_volume" released by "delete_volume" :: held 5.240s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:00 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2289266a-e4e3-46cf-8571-a650cc3f8d7a tempest-VolumesMetadataTest-899789289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 2.000s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:00 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-2289266a-e4e3-46cf-8571-a650cc3f8d7a tempest-VolumesMetadataTest-899789289 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:16:00 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-2289266a-e4e3-46cf-8571-a650cc3f8d7a tempest-VolumesMetadataTest-899789289 None] Deleted volume successfully. Jun 29 11:16:00 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2289266a-e4e3-46cf-8571-a650cc3f8d7a tempest-VolumesMetadataTest-899789289 None] Lock "cinder-e0e74809-b8e8-4e61-a012-fe893a01accf-delete_volume" released by "delete_volume" :: held 5.592s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:02 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-5643138d-e54c-4f3b-9791-af22930c1dcb req-75df13ea-6c3e-4588-880e-e8a0569e081e tempest-TestInstancesWithCinderVolumes-1178480732 None] Terminate volume connection completed successfully. Jun 29 11:16:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-5643138d-e54c-4f3b-9791-af22930c1dcb req-75df13ea-6c3e-4588-880e-e8a0569e081e tempest-TestInstancesWithCinderVolumes-1178480732 None] Deleting attachment 85907bd9-5012-44bf-b2cc-ba741b362bea. {{(pid=93497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 11:16:04 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e7757fb6-6331-4427-9f01-6ae51fa6f6a0 tempest-TestInstancesWithCinderVolumes-1178480732 None] Acquiring lock "cinder-d9f314df-b0e7-485a-96b7-6a80486b86f3-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:16:04 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e7757fb6-6331-4427-9f01-6ae51fa6f6a0 tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "cinder-d9f314df-b0e7-485a-96b7-6a80486b86f3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:16:04 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e7757fb6-6331-4427-9f01-6ae51fa6f6a0 tempest-TestInstancesWithCinderVolumes-1178480732 None] Acquiring lock "cinder-quobyte-d9f314df-b0e7-485a-96b7-6a80486b86f3" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:16:04 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e7757fb6-6331-4427-9f01-6ae51fa6f6a0 tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "cinder-quobyte-d9f314df-b0e7-485a-96b7-6a80486b86f3" acquired by "delete_volume" :: waited 0.019s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:16:04 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35716f4-a3b3-42b8-8bd2-e4cc8e6bafb6]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:16:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e7757fb6-6331-4427-9f01-6ae51fa6f6a0 tempest-TestInstancesWithCinderVolumes-1178480732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d9f314df-b0e7-485a-96b7-6a80486b86f3 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:04 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d9f314df-b0e7-485a-96b7-6a80486b86f3 Jun 29 11:16:04 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:05 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:16:05 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] Flow 'volume_create_manager' (060d4943-738f-4e88-948e-0dc75a48dc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:16:05 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:05 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99e01976-2f78-43a7-be21-94e274684e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e7757fb6-6331-4427-9f01-6ae51fa6f6a0 tempest-TestInstancesWithCinderVolumes-1178480732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d9f314df-b0e7-485a-96b7-6a80486b86f3" returned: 0 in 0.963s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e7757fb6-6331-4427-9f01-6ae51fa6f6a0 tempest-TestInstancesWithCinderVolumes-1178480732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d9f314df-b0e7-485a-96b7-6a80486b86f3 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:05 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99e01976-2f78-43a7-be21-94e274684e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1919717234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650263c8-86d7-47b4-832d-02c33a2795fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b09f818f0064e969f35102041a0db21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:16:06Z,use_quota=True,user_id='8823947deb0547c483595f9d8f5f22dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:05 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d9f314df-b0e7-485a-96b7-6a80486b86f3 Jun 29 11:16:05 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:05 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f0daf89-bdc3-4752-941f-50ae3c5d90a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:05 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f0daf89-bdc3-4752-941f-50ae3c5d90a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:05 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02246a8d-2af6-4bcd-b3a7-43e050d29e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:05 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02246a8d-2af6-4bcd-b3a7-43e050d29e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '650263c8-86d7-47b4-832d-02c33a2795fe', 'volume_name': 'volume-650263c8-86d7-47b4-832d-02c33a2795fe', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:05 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b47904-cc1c-456d-a9c2-798e0c751324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:05 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b47904-cc1c-456d-a9c2-798e0c751324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:05 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (303cc8a3-a20d-4ad4-854b-0d814d7b0780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:05 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] Volume 650263c8-86d7-47b4-832d-02c33a2795fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-650263c8-86d7-47b4-832d-02c33a2795fe', 'volume_size': 1} Jun 29 11:16:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:05 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1919717234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650263c8-86d7-47b4-832d-02c33a2795fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b09f818f0064e969f35102041a0db21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:16:06Z,use_quota=True,user_id='8823947deb0547c483595f9d8f5f22dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:16:05 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] Creating volume 650263c8-86d7-47b4-832d-02c33a2795fe {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:16:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:05 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:16:05 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:16:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:05 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:16:05 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:16:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-650263c8-86d7-47b4-832d-02c33a2795fe 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:05 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-650263c8-86d7-47b4-832d-02c33a2795fe 1073741824 Jun 29 11:16:05 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:06 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e7757fb6-6331-4427-9f01-6ae51fa6f6a0 tempest-TestInstancesWithCinderVolumes-1178480732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d9f314df-b0e7-485a-96b7-6a80486b86f3" returned: 0 in 0.940s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e7757fb6-6331-4427-9f01-6ae51fa6f6a0 tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "cinder-quobyte-d9f314df-b0e7-485a-96b7-6a80486b86f3" released by "delete_volume" :: held 1.971s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:06 devstack cinder-volume[93497]: WARNING cinder.quota [None req-e7757fb6-6331-4427-9f01-6ae51fa6f6a0 tempest-TestInstancesWithCinderVolumes-1178480732 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-649353393-607923436 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-649353393-607923436, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:16:06 devstack cinder-volume[93497]: WARNING cinder.quota [None req-e7757fb6-6331-4427-9f01-6ae51fa6f6a0 tempest-TestInstancesWithCinderVolumes-1178480732 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-649353393-607923436 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-649353393-607923436, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:16:06 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-e7757fb6-6331-4427-9f01-6ae51fa6f6a0 tempest-TestInstancesWithCinderVolumes-1178480732 None] Created reservations ['d4040337-afef-45cb-b8cf-55cd5981d251', 'e5b4234c-6220-4e27-a2d6-94162a1f9725', '23624410-9f73-4ea4-a7fb-f3e981353a7e', 'dace26a8-7a4e-40f4-9208-27decb2a5eb1'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:16:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e7757fb6-6331-4427-9f01-6ae51fa6f6a0 tempest-TestInstancesWithCinderVolumes-1178480732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e7757fb6-6331-4427-9f01-6ae51fa6f6a0 tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:06 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-e7757fb6-6331-4427-9f01-6ae51fa6f6a0 tempest-TestInstancesWithCinderVolumes-1178480732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:16:06 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-e7757fb6-6331-4427-9f01-6ae51fa6f6a0 tempest-TestInstancesWithCinderVolumes-1178480732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:16:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e7757fb6-6331-4427-9f01-6ae51fa6f6a0 tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e7757fb6-6331-4427-9f01-6ae51fa6f6a0 tempest-TestInstancesWithCinderVolumes-1178480732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:06 devstack sudo[104676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:16:06 devstack sudo[104676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:07 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:16:07 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] Flow 'volume_create_manager' (f03bf761-efe2-491c-a6e3-93fcac7f53a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:16:07 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8238111-ec0b-4b08-8269-6aedb6d43a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:07 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-650263c8-86d7-47b4-832d-02c33a2795fe 1073741824" returned: 0 in 1.369s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:07 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8238111-ec0b-4b08-8269-6aedb6d43a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-713786519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=720345be-1026-4f76-85b0-7ef33cc71686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4661f8719a84d649e627bc24cce04ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:16:07Z,use_quota=True,user_id='92b22b12f23e4c6fb93da99ac422fce5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:07 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b034c0b-687c-4aad-acc7-9e0e9328d4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:07 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b034c0b-687c-4aad-acc7-9e0e9328d4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:07 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae92c13-eb32-4c7f-9355-3038d6b012bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:07 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae92c13-eb32-4c7f-9355-3038d6b012bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '720345be-1026-4f76-85b0-7ef33cc71686', 'volume_name': 'volume-720345be-1026-4f76-85b0-7ef33cc71686', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:07 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c39e33b-875e-4f01-8910-0b9fb6d5d150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:07 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c39e33b-875e-4f01-8910-0b9fb6d5d150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:07 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b876cb-88b6-4a0a-b036-e1f236439e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:07 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] Volume 720345be-1026-4f76-85b0-7ef33cc71686: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-720345be-1026-4f76-85b0-7ef33cc71686', 'volume_size': 1} Jun 29 11:16:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-650263c8-86d7-47b4-832d-02c33a2795fe {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:07 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-650263c8-86d7-47b4-832d-02c33a2795fe Jun 29 11:16:07 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:07 devstack sudo[104676]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e7757fb6-6331-4427-9f01-6ae51fa6f6a0 tempest-TestInstancesWithCinderVolumes-1178480732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.987s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:07 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-e7757fb6-6331-4427-9f01-6ae51fa6f6a0 tempest-TestInstancesWithCinderVolumes-1178480732 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:16:07 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-e7757fb6-6331-4427-9f01-6ae51fa6f6a0 tempest-TestInstancesWithCinderVolumes-1178480732 None] Deleted volume successfully. Jun 29 11:16:07 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e7757fb6-6331-4427-9f01-6ae51fa6f6a0 tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "cinder-d9f314df-b0e7-485a-96b7-6a80486b86f3-delete_volume" released by "delete_volume" :: held 3.350s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:08 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:16:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:16:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:16:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:08 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:16:08 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:08 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-650263c8-86d7-47b4-832d-02c33a2795fe" returned: 0 in 1.051s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] <== create_volume: return (2510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:16:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.514s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.094s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-713786519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=720345be-1026-4f76-85b0-7ef33cc71686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4661f8719a84d649e627bc24cce04ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:16:07Z,use_quota=True,user_id='92b22b12f23e4c6fb93da99ac422fce5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:16:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] Creating volume 720345be-1026-4f76-85b0-7ef33cc71686 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:16:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:16:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:16:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:16:08 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:16:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-720345be-1026-4f76-85b0-7ef33cc71686 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:08 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (303cc8a3-a20d-4ad4-854b-0d814d7b0780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-650263c8-86d7-47b4-832d-02c33a2795fe', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:08 devstack sudo[104694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-720345be-1026-4f76-85b0-7ef33cc71686 1073741824 Jun 29 11:16:08 devstack sudo[104694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:08 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc730ec-d4e9-4aff-b3fc-89bcc2952414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:08 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] Volume volume-650263c8-86d7-47b4-832d-02c33a2795fe (650263c8-86d7-47b4-832d-02c33a2795fe): created successfully Jun 29 11:16:08 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc730ec-d4e9-4aff-b3fc-89bcc2952414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:08 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] Flow 'volume_create_manager' (060d4943-738f-4e88-948e-0dc75a48dc2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:16:08 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-b54c176a-91f8-4f86-953e-09317cf824d6 tempest-VolumesTransfersTest-1772000165 None] Created volume successfully. Jun 29 11:16:09 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.008s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:09 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:16:09 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager._thread_info {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:16:09 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread count: 29 {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 11:16:09 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread info: [<_MainThread(MainThread, started 131117520400512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 11:16:10 devstack sudo[104694]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-720345be-1026-4f76-85b0-7ef33cc71686 1073741824" returned: 0 in 1.820s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-720345be-1026-4f76-85b0-7ef33cc71686 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:10 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-720345be-1026-4f76-85b0-7ef33cc71686 Jun 29 11:16:10 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:10 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-8346a340-80e9-4c0c-a9eb-f897083b6775 tempest-VolumesTransfersTest-1719461461 None] Transfer volume completed successfully. Jun 29 11:16:11 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-720345be-1026-4f76-85b0-7ef33cc71686" returned: 0 in 0.758s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:11 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] <== create_volume: return (2675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:16:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.684s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:11 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70b876cb-88b6-4a0a-b036-e1f236439e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-720345be-1026-4f76-85b0-7ef33cc71686', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:11 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b77ab5c6-eb9f-400b-8f30-f4fe52674592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:11 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] Volume volume-720345be-1026-4f76-85b0-7ef33cc71686 (720345be-1026-4f76-85b0-7ef33cc71686): created successfully Jun 29 11:16:11 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b77ab5c6-eb9f-400b-8f30-f4fe52674592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:11 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] Flow 'volume_create_manager' (f03bf761-efe2-491c-a6e3-93fcac7f53a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:16:11 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-9a48bc4e-26b8-40af-8ff5-900d0b01a1ff tempest-VolumesActionsTest-138828446 None] Created volume successfully. Jun 29 11:16:11 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-9a6532dd-6abe-430d-a96f-f3f49962dbb7 tempest-VolumesTransfersTest-1441004970 None] Acquiring lock "cinder-650263c8-86d7-47b4-832d-02c33a2795fe-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:16:11 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-9a6532dd-6abe-430d-a96f-f3f49962dbb7 tempest-VolumesTransfersTest-1441004970 None] Lock "cinder-650263c8-86d7-47b4-832d-02c33a2795fe-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:16:11 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f6ece6ae-9c6e-47f1-987f-f783625ee559 tempest-VolumesActionsTest-731361052 None] Acquiring lock "cinder-720345be-1026-4f76-85b0-7ef33cc71686-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:16:11 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-9a6532dd-6abe-430d-a96f-f3f49962dbb7 tempest-VolumesTransfersTest-1441004970 None] Acquiring lock "cinder-quobyte-650263c8-86d7-47b4-832d-02c33a2795fe" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:16:11 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f6ece6ae-9c6e-47f1-987f-f783625ee559 tempest-VolumesActionsTest-731361052 None] Lock "cinder-720345be-1026-4f76-85b0-7ef33cc71686-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:16:11 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-9a6532dd-6abe-430d-a96f-f3f49962dbb7 tempest-VolumesTransfersTest-1441004970 None] Lock "cinder-quobyte-650263c8-86d7-47b4-832d-02c33a2795fe" acquired by "delete_volume" :: waited 0.033s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:16:11 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c754e7-34ac-45b2-b1b8-ad803092c17a]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:16:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9a6532dd-6abe-430d-a96f-f3f49962dbb7 tempest-VolumesTransfersTest-1441004970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-650263c8-86d7-47b4-832d-02c33a2795fe {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:12 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f6ece6ae-9c6e-47f1-987f-f783625ee559 tempest-VolumesActionsTest-731361052 None] Acquiring lock "cinder-quobyte-720345be-1026-4f76-85b0-7ef33cc71686" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:16:12 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:16:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] Flow 'volume_create_manager' (b4119944-7c06-44e8-8078-5cf1b8281a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:16:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7adc589-4580-42b4-b118-729826633884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:12 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f6ece6ae-9c6e-47f1-987f-f783625ee559 tempest-VolumesActionsTest-731361052 None] Lock "cinder-quobyte-720345be-1026-4f76-85b0-7ef33cc71686" acquired by "delete_volume" :: waited 0.053s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:16:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7adc589-4580-42b4-b118-729826633884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2033895960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00e72059-932a-4766-a9e5-da8afec02870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6152cfa9d1478d850e417348a1c4dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:16:12Z,use_quota=True,user_id='62e68c840d124d71b52de38778cc57d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84509ee2-0584-406e-a1e4-885e4243979f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84509ee2-0584-406e-a1e4-885e4243979f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc00d094-af95-4628-9b16-8a3babd608bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc00d094-af95-4628-9b16-8a3babd608bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00e72059-932a-4766-a9e5-da8afec02870', 'volume_name': 'volume-00e72059-932a-4766-a9e5-da8afec02870', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12521d7a-be73-45b3-9fe5-ac2cbe480139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12521d7a-be73-45b3-9fe5-ac2cbe480139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:12 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-650263c8-86d7-47b4-832d-02c33a2795fe Jun 29 11:16:12 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c18c7576-ccf2-4644-abc1-55daaeea9a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:12 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] Volume 00e72059-932a-4766-a9e5-da8afec02870: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00e72059-932a-4766-a9e5-da8afec02870', 'volume_size': 1} Jun 29 11:16:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:12 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2033895960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00e72059-932a-4766-a9e5-da8afec02870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6152cfa9d1478d850e417348a1c4dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:16:12Z,use_quota=True,user_id='62e68c840d124d71b52de38778cc57d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:16:12 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] Creating volume 00e72059-932a-4766-a9e5-da8afec02870 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:16:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:12 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:16:12 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:16:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:12 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:16:12 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:16:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-00e72059-932a-4766-a9e5-da8afec02870 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:12 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc1ee58-7fdb-4357-b1f1-dc544d323071]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:16:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f6ece6ae-9c6e-47f1-987f-f783625ee559 tempest-VolumesActionsTest-731361052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-720345be-1026-4f76-85b0-7ef33cc71686 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:12 devstack sudo[104750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-00e72059-932a-4766-a9e5-da8afec02870 1073741824 Jun 29 11:16:12 devstack sudo[104750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:12 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-720345be-1026-4f76-85b0-7ef33cc71686 Jun 29 11:16:12 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:12 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9a6532dd-6abe-430d-a96f-f3f49962dbb7 tempest-VolumesTransfersTest-1441004970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-650263c8-86d7-47b4-832d-02c33a2795fe" returned: 0 in 0.971s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9a6532dd-6abe-430d-a96f-f3f49962dbb7 tempest-VolumesTransfersTest-1441004970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-650263c8-86d7-47b4-832d-02c33a2795fe {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:13 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-650263c8-86d7-47b4-832d-02c33a2795fe Jun 29 11:16:13 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:13 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f6ece6ae-9c6e-47f1-987f-f783625ee559 tempest-VolumesActionsTest-731361052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-720345be-1026-4f76-85b0-7ef33cc71686" returned: 0 in 1.004s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f6ece6ae-9c6e-47f1-987f-f783625ee559 tempest-VolumesActionsTest-731361052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-720345be-1026-4f76-85b0-7ef33cc71686 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:13 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-720345be-1026-4f76-85b0-7ef33cc71686 Jun 29 11:16:13 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:13 devstack sudo[104750]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-00e72059-932a-4766-a9e5-da8afec02870 1073741824" returned: 0 in 1.074s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-00e72059-932a-4766-a9e5-da8afec02870 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:13 devstack sudo[104769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-00e72059-932a-4766-a9e5-da8afec02870 Jun 29 11:16:13 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:13 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-f052fdf0-4e05-46b8-8fad-7bce3c41f330 req-01284e34-56db-47c3-9444-0d1b0c96ff58 tempest-TestInstancesWithCinderVolumes-1178480732 None] Terminate volume connection completed successfully. Jun 29 11:16:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-f052fdf0-4e05-46b8-8fad-7bce3c41f330 req-01284e34-56db-47c3-9444-0d1b0c96ff58 tempest-TestInstancesWithCinderVolumes-1178480732 None] Deleting attachment 45728ed3-fda7-44d7-ab2f-8669718c078e. {{(pid=93497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 11:16:13 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9a6532dd-6abe-430d-a96f-f3f49962dbb7 tempest-VolumesTransfersTest-1441004970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-650263c8-86d7-47b4-832d-02c33a2795fe" returned: 0 in 0.753s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:13 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-9a6532dd-6abe-430d-a96f-f3f49962dbb7 tempest-VolumesTransfersTest-1441004970 None] Lock "cinder-quobyte-650263c8-86d7-47b4-832d-02c33a2795fe" released by "delete_volume" :: held 1.798s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:13 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-9a6532dd-6abe-430d-a96f-f3f49962dbb7 tempest-VolumesTransfersTest-1441004970 None] Created reservations ['1a2d97ef-c585-43a8-acf4-1806747bc5e6', 'af126727-f2f7-4390-9d84-86e74b22d28d', '61452842-c3b3-449a-bf50-c75c0e39c02c', '8ceb5316-b693-45dc-a736-6e98e30e4095'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:16:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9a6532dd-6abe-430d-a96f-f3f49962dbb7 tempest-VolumesTransfersTest-1441004970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9a6532dd-6abe-430d-a96f-f3f49962dbb7 tempest-VolumesTransfersTest-1441004970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:13 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9a6532dd-6abe-430d-a96f-f3f49962dbb7 tempest-VolumesTransfersTest-1441004970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:16:13 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9a6532dd-6abe-430d-a96f-f3f49962dbb7 tempest-VolumesTransfersTest-1441004970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:16:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9a6532dd-6abe-430d-a96f-f3f49962dbb7 tempest-VolumesTransfersTest-1441004970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9a6532dd-6abe-430d-a96f-f3f49962dbb7 tempest-VolumesTransfersTest-1441004970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:13 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f6ece6ae-9c6e-47f1-987f-f783625ee559 tempest-VolumesActionsTest-731361052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-720345be-1026-4f76-85b0-7ef33cc71686" returned: 0 in 0.705s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:13 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:16:13 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f6ece6ae-9c6e-47f1-987f-f783625ee559 tempest-VolumesActionsTest-731361052 None] Lock "cinder-quobyte-720345be-1026-4f76-85b0-7ef33cc71686" released by "delete_volume" :: held 1.862s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:13 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:13 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-00e72059-932a-4766-a9e5-da8afec02870" returned: 0 in 0.702s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:13 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:16:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:14 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c18c7576-ccf2-4644-abc1-55daaeea9a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00e72059-932a-4766-a9e5-da8afec02870', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:14 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93127709-13f4-4b03-98ae-cb2332bd50f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:14 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] Volume volume-00e72059-932a-4766-a9e5-da8afec02870 (00e72059-932a-4766-a9e5-da8afec02870): created successfully Jun 29 11:16:14 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93127709-13f4-4b03-98ae-cb2332bd50f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:14 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] Flow 'volume_create_manager' (b4119944-7c06-44e8-8078-5cf1b8281a2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:16:14 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-fafba4f8-39d0-4be7-bf9d-66001acd66d0 tempest-AttachVolumeNegativeTest-1748370238 None] Created volume successfully. Jun 29 11:16:14 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-f6ece6ae-9c6e-47f1-987f-f783625ee559 tempest-VolumesActionsTest-731361052 None] Created reservations ['339ca702-0854-4c35-82fe-8af1f7b1a81c', '2e85e0b5-3d85-46b9-a27a-b66e3d922b72', '1855322a-1237-484f-b368-36fe31a7968b', 'ac4afb8f-21f4-4296-8b45-be6879edd78d'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:16:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f6ece6ae-9c6e-47f1-987f-f783625ee559 tempest-VolumesActionsTest-731361052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f6ece6ae-9c6e-47f1-987f-f783625ee559 tempest-VolumesActionsTest-731361052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:14 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f6ece6ae-9c6e-47f1-987f-f783625ee559 tempest-VolumesActionsTest-731361052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:16:14 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f6ece6ae-9c6e-47f1-987f-f783625ee559 tempest-VolumesActionsTest-731361052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:16:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f6ece6ae-9c6e-47f1-987f-f783625ee559 tempest-VolumesActionsTest-731361052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f6ece6ae-9c6e-47f1-987f-f783625ee559 tempest-VolumesActionsTest-731361052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:14 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:16:14 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:14 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9a6532dd-6abe-430d-a96f-f3f49962dbb7 tempest-VolumesTransfersTest-1441004970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.932s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:14 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-9a6532dd-6abe-430d-a96f-f3f49962dbb7 tempest-VolumesTransfersTest-1441004970 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:16:14 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-9a6532dd-6abe-430d-a96f-f3f49962dbb7 tempest-VolumesTransfersTest-1441004970 None] Deleted volume successfully. Jun 29 11:16:14 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-9a6532dd-6abe-430d-a96f-f3f49962dbb7 tempest-VolumesTransfersTest-1441004970 None] Lock "cinder-650263c8-86d7-47b4-832d-02c33a2795fe-delete_volume" released by "delete_volume" :: held 3.074s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:15 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f6ece6ae-9c6e-47f1-987f-f783625ee559 tempest-VolumesActionsTest-731361052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.811s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-f6ece6ae-9c6e-47f1-987f-f783625ee559 tempest-VolumesActionsTest-731361052 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:16:15 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-f6ece6ae-9c6e-47f1-987f-f783625ee559 tempest-VolumesActionsTest-731361052 None] Deleted volume successfully. Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f6ece6ae-9c6e-47f1-987f-f783625ee559 tempest-VolumesActionsTest-731361052 None] Lock "cinder-720345be-1026-4f76-85b0-7ef33cc71686-delete_volume" released by "delete_volume" :: held 3.125s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] Flow 'volume_create_manager' (8585aa2f-29f9-4567-b107-159729233706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73bf728a-6f8e-4f53-b9dc-566b8d1935a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73bf728a-6f8e-4f53-b9dc-566b8d1935a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-368947818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d200dc27-79c2-4260-8633-da75cc55fcb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b09f818f0064e969f35102041a0db21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:16:15Z,use_quota=True,user_id='8823947deb0547c483595f9d8f5f22dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1988e708-0e47-46c7-9115-7a1a24496d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1988e708-0e47-46c7-9115-7a1a24496d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d96d9e70-3e48-4cf4-94a8-de6239035e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d96d9e70-3e48-4cf4-94a8-de6239035e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd200dc27-79c2-4260-8633-da75cc55fcb9', 'volume_name': 'volume-d200dc27-79c2-4260-8633-da75cc55fcb9', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf0a17ca-fdaf-4692-b520-709200bee918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf0a17ca-fdaf-4692-b520-709200bee918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b798db7a-2f05-463f-8c22-e9d8663ec7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:15 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] Volume d200dc27-79c2-4260-8633-da75cc55fcb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d200dc27-79c2-4260-8633-da75cc55fcb9', 'volume_size': 1} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-368947818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d200dc27-79c2-4260-8633-da75cc55fcb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b09f818f0064e969f35102041a0db21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:16:15Z,use_quota=True,user_id='8823947deb0547c483595f9d8f5f22dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] Creating volume d200dc27-79c2-4260-8633-da75cc55fcb9 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:16:15 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d200dc27-79c2-4260-8633-da75cc55fcb9 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:15 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d200dc27-79c2-4260-8633-da75cc55fcb9 1073741824 Jun 29 11:16:15 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] Flow 'volume_create_manager' (a587e152-80dc-4dfe-ad79-4bd719df1c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60cabfa1-c514-4f31-9140-0c33bc7418b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60cabfa1-c514-4f31-9140-0c33bc7418b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1331611715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46279fe3-9f4b-4bef-b396-a0c9e236f269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4661f8719a84d649e627bc24cce04ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:16:15Z,use_quota=True,user_id='92b22b12f23e4c6fb93da99ac422fce5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (631635b8-e9e3-43b7-90c5-ea318e9e8a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (631635b8-e9e3-43b7-90c5-ea318e9e8a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c016a01-b583-49ca-90f9-e8ebccd8bf62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c016a01-b583-49ca-90f9-e8ebccd8bf62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46279fe3-9f4b-4bef-b396-a0c9e236f269', 'volume_name': 'volume-46279fe3-9f4b-4bef-b396-a0c9e236f269', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (879112c2-ae4d-4abf-af1c-5172f883deaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (879112c2-ae4d-4abf-af1c-5172f883deaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd2d53cd-4231-45a5-837e-639a3171d5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:15 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] Volume 46279fe3-9f4b-4bef-b396-a0c9e236f269: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46279fe3-9f4b-4bef-b396-a0c9e236f269', 'volume_size': 1} Jun 29 11:16:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:16 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d200dc27-79c2-4260-8633-da75cc55fcb9 1073741824" returned: 0 in 0.901s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d200dc27-79c2-4260-8633-da75cc55fcb9 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:16 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d200dc27-79c2-4260-8633-da75cc55fcb9 Jun 29 11:16:16 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:16 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d200dc27-79c2-4260-8633-da75cc55fcb9" returned: 0 in 0.633s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:16 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:16:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.448s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:16 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1331611715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46279fe3-9f4b-4bef-b396-a0c9e236f269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4661f8719a84d649e627bc24cce04ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:16:15Z,use_quota=True,user_id='92b22b12f23e4c6fb93da99ac422fce5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:16:16 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] Creating volume 46279fe3-9f4b-4bef-b396-a0c9e236f269 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:16:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:16 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:16:16 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:16:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:16 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:16:16 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:16:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-46279fe3-9f4b-4bef-b396-a0c9e236f269 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:16 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-46279fe3-9f4b-4bef-b396-a0c9e236f269 1073741824 Jun 29 11:16:16 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b798db7a-2f05-463f-8c22-e9d8663ec7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d200dc27-79c2-4260-8633-da75cc55fcb9', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bbdae81-04b5-4fc2-a150-6a6b85005bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:16 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] Volume volume-d200dc27-79c2-4260-8633-da75cc55fcb9 (d200dc27-79c2-4260-8633-da75cc55fcb9): created successfully Jun 29 11:16:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bbdae81-04b5-4fc2-a150-6a6b85005bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] Flow 'volume_create_manager' (8585aa2f-29f9-4567-b107-159729233706) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:16:16 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-39d92ac7-4020-45bc-8c90-63d752b29d83 tempest-VolumesTransfersTest-1772000165 None] Created volume successfully. Jun 29 11:16:17 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fc0c5f12-de12-4acd-9546-cbd2581f66d3 tempest-TestInstancesWithCinderVolumes-1178480732 None] Acquiring lock "cinder-33ac57f4-de16-4d43-b458-f07caa102e3d-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:16:17 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fc0c5f12-de12-4acd-9546-cbd2581f66d3 tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "cinder-33ac57f4-de16-4d43-b458-f07caa102e3d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:16:17 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fc0c5f12-de12-4acd-9546-cbd2581f66d3 tempest-TestInstancesWithCinderVolumes-1178480732 None] Acquiring lock "cinder-quobyte-33ac57f4-de16-4d43-b458-f07caa102e3d" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:16:17 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fc0c5f12-de12-4acd-9546-cbd2581f66d3 tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "cinder-quobyte-33ac57f4-de16-4d43-b458-f07caa102e3d" acquired by "delete_volume" :: waited 0.026s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:16:17 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0618ee78-32a5-48b8-b540-9986daabc1c6]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:16:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fc0c5f12-de12-4acd-9546-cbd2581f66d3 tempest-TestInstancesWithCinderVolumes-1178480732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:17 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d Jun 29 11:16:17 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:17 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-46279fe3-9f4b-4bef-b396-a0c9e236f269 1073741824" returned: 0 in 1.021s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-46279fe3-9f4b-4bef-b396-a0c9e236f269 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:17 devstack sudo[104803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-46279fe3-9f4b-4bef-b396-a0c9e236f269 Jun 29 11:16:17 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-49ac4d83-794a-4d9f-b9ad-f7805cb73e8c req-aa2eb141-7861-4fe8-a12e-6df71931e339 tempest-AttachVolumeNegativeTest-1748370238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:18 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-99e88ef5-e96c-4ee0-bedb-b537510ece11 tempest-VolumesTransfersTest-1441004970 None] Acquiring lock "cinder-d200dc27-79c2-4260-8633-da75cc55fcb9-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:16:18 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-99e88ef5-e96c-4ee0-bedb-b537510ece11 tempest-VolumesTransfersTest-1441004970 None] Lock "cinder-d200dc27-79c2-4260-8633-da75cc55fcb9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:16:18 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-99e88ef5-e96c-4ee0-bedb-b537510ece11 tempest-VolumesTransfersTest-1441004970 None] Acquiring lock "cinder-quobyte-d200dc27-79c2-4260-8633-da75cc55fcb9" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:16:18 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-99e88ef5-e96c-4ee0-bedb-b537510ece11 tempest-VolumesTransfersTest-1441004970 None] Lock "cinder-quobyte-d200dc27-79c2-4260-8633-da75cc55fcb9" acquired by "delete_volume" :: waited 0.016s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:16:18 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb86c85-3e05-43d6-a672-99ad71abf281]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:16:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-99e88ef5-e96c-4ee0-bedb-b537510ece11 tempest-VolumesTransfersTest-1441004970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d200dc27-79c2-4260-8633-da75cc55fcb9 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:18 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fc0c5f12-de12-4acd-9546-cbd2581f66d3 tempest-TestInstancesWithCinderVolumes-1178480732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d" returned: 0 in 0.930s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fc0c5f12-de12-4acd-9546-cbd2581f66d3 tempest-TestInstancesWithCinderVolumes-1178480732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:18 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-46279fe3-9f4b-4bef-b396-a0c9e236f269" returned: 0 in 0.789s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:18 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:16:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-49ac4d83-794a-4d9f-b9ad-f7805cb73e8c req-aa2eb141-7861-4fe8-a12e-6df71931e339 tempest-AttachVolumeNegativeTest-1748370238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.346s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:18 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd2d53cd-4231-45a5-837e-639a3171d5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46279fe3-9f4b-4bef-b396-a0c9e236f269', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:18 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e94b3d3-769e-4ef8-a365-e2d0a57d5ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:18 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c21c76b-b2a6-4720-ab9d-bea253f88326]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:16:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-49ac4d83-794a-4d9f-b9ad-f7805cb73e8c req-aa2eb141-7861-4fe8-a12e-6df71931e339 tempest-AttachVolumeNegativeTest-1748370238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-00e72059-932a-4766-a9e5-da8afec02870 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:18 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d200dc27-79c2-4260-8633-da75cc55fcb9 Jun 29 11:16:18 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:18 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] Volume volume-46279fe3-9f4b-4bef-b396-a0c9e236f269 (46279fe3-9f4b-4bef-b396-a0c9e236f269): created successfully Jun 29 11:16:18 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e94b3d3-769e-4ef8-a365-e2d0a57d5ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:18 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] Flow 'volume_create_manager' (a587e152-80dc-4dfe-ad79-4bd719df1c68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:16:18 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-2efaafc4-2983-428b-8286-e4aa4a572f97 tempest-VolumesActionsTest-138828446 None] Created volume successfully. Jun 29 11:16:18 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d Jun 29 11:16:18 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:18 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-00e72059-932a-4766-a9e5-da8afec02870 Jun 29 11:16:18 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:19 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1447b1ba-662b-4cdc-9fbe-8f707e82358c tempest-VolumesActionsTest-731361052 None] Acquiring lock "cinder-46279fe3-9f4b-4bef-b396-a0c9e236f269-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:16:19 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1447b1ba-662b-4cdc-9fbe-8f707e82358c tempest-VolumesActionsTest-731361052 None] Lock "cinder-46279fe3-9f4b-4bef-b396-a0c9e236f269-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:16:19 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1447b1ba-662b-4cdc-9fbe-8f707e82358c tempest-VolumesActionsTest-731361052 None] Acquiring lock "cinder-quobyte-46279fe3-9f4b-4bef-b396-a0c9e236f269" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:16:19 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1447b1ba-662b-4cdc-9fbe-8f707e82358c tempest-VolumesActionsTest-731361052 None] Lock "cinder-quobyte-46279fe3-9f4b-4bef-b396-a0c9e236f269" acquired by "delete_volume" :: waited 0.029s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:16:19 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-99e88ef5-e96c-4ee0-bedb-b537510ece11 tempest-VolumesTransfersTest-1441004970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d200dc27-79c2-4260-8633-da75cc55fcb9" returned: 0 in 0.914s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-99e88ef5-e96c-4ee0-bedb-b537510ece11 tempest-VolumesTransfersTest-1441004970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d200dc27-79c2-4260-8633-da75cc55fcb9 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:19 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c749d206-5d2c-4f09-8830-a90beab3b699]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:16:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1447b1ba-662b-4cdc-9fbe-8f707e82358c tempest-VolumesActionsTest-731361052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-46279fe3-9f4b-4bef-b396-a0c9e236f269 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:19 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d200dc27-79c2-4260-8633-da75cc55fcb9 Jun 29 11:16:19 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:19 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fc0c5f12-de12-4acd-9546-cbd2581f66d3 tempest-TestInstancesWithCinderVolumes-1178480732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d" returned: 1 in 0.993s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fc0c5f12-de12-4acd-9546-cbd2581f66d3 tempest-TestInstancesWithCinderVolumes-1178480732 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:16:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fc0c5f12-de12-4acd-9546-cbd2581f66d3 tempest-TestInstancesWithCinderVolumes-1178480732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:19 devstack sudo[104833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-46279fe3-9f4b-4bef-b396-a0c9e236f269 Jun 29 11:16:19 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:19 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d Jun 29 11:16:19 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:19 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-49ac4d83-794a-4d9f-b9ad-f7805cb73e8c req-aa2eb141-7861-4fe8-a12e-6df71931e339 tempest-AttachVolumeNegativeTest-1748370238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-00e72059-932a-4766-a9e5-da8afec02870" returned: 0 in 0.954s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-49ac4d83-794a-4d9f-b9ad-f7805cb73e8c req-aa2eb141-7861-4fe8-a12e-6df71931e339 tempest-AttachVolumeNegativeTest-1748370238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.993s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-49ac4d83-794a-4d9f-b9ad-f7805cb73e8c req-aa2eb141-7861-4fe8-a12e-6df71931e339 tempest-AttachVolumeNegativeTest-1748370238 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3', 'name': 'volume-00e72059-932a-4766-a9e5-da8afec02870', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a8d1cee3-ae0c-40f0-ad15-69c0d08e71f6', 'enforce_multipath': True} {{(pid=93497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 11:16:19 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-49ac4d83-794a-4d9f-b9ad-f7805cb73e8c req-aa2eb141-7861-4fe8-a12e-6df71931e339 tempest-AttachVolumeNegativeTest-1748370238 None] attachment_update completed successfully. Jun 29 11:16:20 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-99e88ef5-e96c-4ee0-bedb-b537510ece11 tempest-VolumesTransfersTest-1441004970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d200dc27-79c2-4260-8633-da75cc55fcb9" returned: 0 in 0.740s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:20 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-99e88ef5-e96c-4ee0-bedb-b537510ece11 tempest-VolumesTransfersTest-1441004970 None] Lock "cinder-quobyte-d200dc27-79c2-4260-8633-da75cc55fcb9" released by "delete_volume" :: held 1.700s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:20 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-99e88ef5-e96c-4ee0-bedb-b537510ece11 tempest-VolumesTransfersTest-1441004970 None] Created reservations ['d570f098-6aad-4ba9-b293-02edfc28746e', '8bf201c4-ba3d-4153-a1e3-7cc359e0369d', 'a18b8873-7048-4c1e-be5f-05dbe9187c4c', '1b61c8ba-d9ae-4031-9567-9021684a8b49'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:16:20 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fc0c5f12-de12-4acd-9546-cbd2581f66d3 tempest-TestInstancesWithCinderVolumes-1178480732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33ac57f4-de16-4d43-b458-f07caa102e3d" returned: 0 in 0.753s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:20 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fc0c5f12-de12-4acd-9546-cbd2581f66d3 tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "cinder-quobyte-33ac57f4-de16-4d43-b458-f07caa102e3d" released by "delete_volume" :: held 2.748s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-99e88ef5-e96c-4ee0-bedb-b537510ece11 tempest-VolumesTransfersTest-1441004970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-99e88ef5-e96c-4ee0-bedb-b537510ece11 tempest-VolumesTransfersTest-1441004970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:20 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-99e88ef5-e96c-4ee0-bedb-b537510ece11 tempest-VolumesTransfersTest-1441004970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:16:20 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-99e88ef5-e96c-4ee0-bedb-b537510ece11 tempest-VolumesTransfersTest-1441004970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:16:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-99e88ef5-e96c-4ee0-bedb-b537510ece11 tempest-VolumesTransfersTest-1441004970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-99e88ef5-e96c-4ee0-bedb-b537510ece11 tempest-VolumesTransfersTest-1441004970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:20 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1447b1ba-662b-4cdc-9fbe-8f707e82358c tempest-VolumesActionsTest-731361052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-46279fe3-9f4b-4bef-b396-a0c9e236f269" returned: 0 in 0.944s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1447b1ba-662b-4cdc-9fbe-8f707e82358c tempest-VolumesActionsTest-731361052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-46279fe3-9f4b-4bef-b396-a0c9e236f269 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:20 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:16:20 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:20 devstack cinder-volume[93497]: WARNING cinder.quota [None req-fc0c5f12-de12-4acd-9546-cbd2581f66d3 tempest-TestInstancesWithCinderVolumes-1178480732 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-120112901-314236704 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-120112901-314236704, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:16:20 devstack cinder-volume[93497]: WARNING cinder.quota [None req-fc0c5f12-de12-4acd-9546-cbd2581f66d3 tempest-TestInstancesWithCinderVolumes-1178480732 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-120112901-314236704 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-120112901-314236704, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:16:20 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-46279fe3-9f4b-4bef-b396-a0c9e236f269 Jun 29 11:16:20 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:20 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-fc0c5f12-de12-4acd-9546-cbd2581f66d3 tempest-TestInstancesWithCinderVolumes-1178480732 None] Created reservations ['53fcc0a5-cee4-4267-8a48-3dc246ae57c9', '8b39c5ee-2119-43e7-89e2-fd05c834bc6d', 'd479e745-0490-4d24-9dbb-291c3b9893b0', '8368c77f-2d70-42f3-9865-be2dc1323a6a'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:16:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fc0c5f12-de12-4acd-9546-cbd2581f66d3 tempest-TestInstancesWithCinderVolumes-1178480732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fc0c5f12-de12-4acd-9546-cbd2581f66d3 tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:20 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-fc0c5f12-de12-4acd-9546-cbd2581f66d3 tempest-TestInstancesWithCinderVolumes-1178480732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:16:20 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-fc0c5f12-de12-4acd-9546-cbd2581f66d3 tempest-TestInstancesWithCinderVolumes-1178480732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:16:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fc0c5f12-de12-4acd-9546-cbd2581f66d3 tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fc0c5f12-de12-4acd-9546-cbd2581f66d3 tempest-TestInstancesWithCinderVolumes-1178480732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:20 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:16:20 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:21 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-99e88ef5-e96c-4ee0-bedb-b537510ece11 tempest-VolumesTransfersTest-1441004970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.009s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:21 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-99e88ef5-e96c-4ee0-bedb-b537510ece11 tempest-VolumesTransfersTest-1441004970 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:16:21 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-99e88ef5-e96c-4ee0-bedb-b537510ece11 tempest-VolumesTransfersTest-1441004970 None] Deleted volume successfully. Jun 29 11:16:21 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-99e88ef5-e96c-4ee0-bedb-b537510ece11 tempest-VolumesTransfersTest-1441004970 None] Lock "cinder-d200dc27-79c2-4260-8633-da75cc55fcb9-delete_volume" released by "delete_volume" :: held 3.014s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:21 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1447b1ba-662b-4cdc-9fbe-8f707e82358c tempest-VolumesActionsTest-731361052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-46279fe3-9f4b-4bef-b396-a0c9e236f269" returned: 0 in 1.090s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:21 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fc0c5f12-de12-4acd-9546-cbd2581f66d3 tempest-TestInstancesWithCinderVolumes-1178480732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.848s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:21 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-fc0c5f12-de12-4acd-9546-cbd2581f66d3 tempest-TestInstancesWithCinderVolumes-1178480732 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:16:21 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1447b1ba-662b-4cdc-9fbe-8f707e82358c tempest-VolumesActionsTest-731361052 None] Lock "cinder-quobyte-46279fe3-9f4b-4bef-b396-a0c9e236f269" released by "delete_volume" :: held 2.096s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:21 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-fc0c5f12-de12-4acd-9546-cbd2581f66d3 tempest-TestInstancesWithCinderVolumes-1178480732 None] Deleted volume successfully. Jun 29 11:16:21 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fc0c5f12-de12-4acd-9546-cbd2581f66d3 tempest-TestInstancesWithCinderVolumes-1178480732 None] Lock "cinder-33ac57f4-de16-4d43-b458-f07caa102e3d-delete_volume" released by "delete_volume" :: held 4.050s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:21 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-1447b1ba-662b-4cdc-9fbe-8f707e82358c tempest-VolumesActionsTest-731361052 None] Created reservations ['3576f0d1-fcaf-4517-88e6-7076c3cc4c37', 'ec4a90f2-3ba6-4dda-89d0-774800987166', '87223900-2174-4be8-9fff-022de2810691', 'b74b1db9-56ff-402d-b613-2a6c02921774'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:16:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1447b1ba-662b-4cdc-9fbe-8f707e82358c tempest-VolumesActionsTest-731361052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1447b1ba-662b-4cdc-9fbe-8f707e82358c tempest-VolumesActionsTest-731361052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:21 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1447b1ba-662b-4cdc-9fbe-8f707e82358c tempest-VolumesActionsTest-731361052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:16:21 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1447b1ba-662b-4cdc-9fbe-8f707e82358c tempest-VolumesActionsTest-731361052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:16:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1447b1ba-662b-4cdc-9fbe-8f707e82358c tempest-VolumesActionsTest-731361052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1447b1ba-662b-4cdc-9fbe-8f707e82358c tempest-VolumesActionsTest-731361052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:21 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:16:21 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:22 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1447b1ba-662b-4cdc-9fbe-8f707e82358c tempest-VolumesActionsTest-731361052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.800s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:22 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-1447b1ba-662b-4cdc-9fbe-8f707e82358c tempest-VolumesActionsTest-731361052 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:16:22 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-1447b1ba-662b-4cdc-9fbe-8f707e82358c tempest-VolumesActionsTest-731361052 None] Deleted volume successfully. Jun 29 11:16:22 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1447b1ba-662b-4cdc-9fbe-8f707e82358c tempest-VolumesActionsTest-731361052 None] Lock "cinder-46279fe3-9f4b-4bef-b396-a0c9e236f269-delete_volume" released by "delete_volume" :: held 3.255s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:23 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:16:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] Flow 'volume_create_manager' (38c4d4fa-5822-4055-a8aa-6d575b32be86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:16:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b71e37-4133-418c-8ab8-4eaeb00ba5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b71e37-4133-418c-8ab8-4eaeb00ba5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2128926277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eda4eaa-c252-4d54-8336-5fb0e3b38079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4661f8719a84d649e627bc24cce04ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:16:24Z,use_quota=True,user_id='92b22b12f23e4c6fb93da99ac422fce5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbae864f-b659-42b1-ac22-7c1bec2ea888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbae864f-b659-42b1-ac22-7c1bec2ea888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e719dbc9-397f-4673-bc73-8f10490dd072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e719dbc9-397f-4673-bc73-8f10490dd072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eda4eaa-c252-4d54-8336-5fb0e3b38079', 'volume_name': 'volume-2eda4eaa-c252-4d54-8336-5fb0e3b38079', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d9a9712-95a7-4727-8652-ad2699d2dba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d9a9712-95a7-4727-8652-ad2699d2dba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (263e0fdf-dc1d-4d71-8817-b2756988bc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:23 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] Volume 2eda4eaa-c252-4d54-8336-5fb0e3b38079: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eda4eaa-c252-4d54-8336-5fb0e3b38079', 'volume_size': 1} Jun 29 11:16:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:23 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2128926277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eda4eaa-c252-4d54-8336-5fb0e3b38079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4661f8719a84d649e627bc24cce04ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:16:24Z,use_quota=True,user_id='92b22b12f23e4c6fb93da99ac422fce5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:16:23 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] Creating volume 2eda4eaa-c252-4d54-8336-5fb0e3b38079 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:16:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:23 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:16:23 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:16:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:23 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:16:23 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:16:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2eda4eaa-c252-4d54-8336-5fb0e3b38079 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:23 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2eda4eaa-c252-4d54-8336-5fb0e3b38079 1073741824 Jun 29 11:16:23 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:24 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2eda4eaa-c252-4d54-8336-5fb0e3b38079 1073741824" returned: 0 in 1.135s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2eda4eaa-c252-4d54-8336-5fb0e3b38079 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:24 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2eda4eaa-c252-4d54-8336-5fb0e3b38079 Jun 29 11:16:24 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:25 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2eda4eaa-c252-4d54-8336-5fb0e3b38079" returned: 0 in 0.945s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:25 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] <== create_volume: return (2132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:16:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.135s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:25 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (263e0fdf-dc1d-4d71-8817-b2756988bc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eda4eaa-c252-4d54-8336-5fb0e3b38079', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:25 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e36f8791-5b3e-40e1-a770-cc75da73ebd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:25 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] Volume volume-2eda4eaa-c252-4d54-8336-5fb0e3b38079 (2eda4eaa-c252-4d54-8336-5fb0e3b38079): created successfully Jun 29 11:16:25 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e36f8791-5b3e-40e1-a770-cc75da73ebd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:25 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] Flow 'volume_create_manager' (38c4d4fa-5822-4055-a8aa-6d575b32be86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:16:26 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-07f79ae0-b95a-4894-900e-065238ed1518 tempest-VolumesActionsTest-138828446 None] Created volume successfully. Jun 29 11:16:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-48966a2d-5e1d-4a82-afe5-4fb27fd262ea tempest-VolumesActionsTest-731361052 None] Acquiring lock "cinder-2eda4eaa-c252-4d54-8336-5fb0e3b38079-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:16:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-48966a2d-5e1d-4a82-afe5-4fb27fd262ea tempest-VolumesActionsTest-731361052 None] Lock "cinder-2eda4eaa-c252-4d54-8336-5fb0e3b38079-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:16:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-48966a2d-5e1d-4a82-afe5-4fb27fd262ea tempest-VolumesActionsTest-731361052 None] Acquiring lock "cinder-quobyte-2eda4eaa-c252-4d54-8336-5fb0e3b38079" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:16:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-48966a2d-5e1d-4a82-afe5-4fb27fd262ea tempest-VolumesActionsTest-731361052 None] Lock "cinder-quobyte-2eda4eaa-c252-4d54-8336-5fb0e3b38079" acquired by "delete_volume" :: waited 0.046s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:16:27 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f37043-d388-41f9-a626-f5f4c886dc98]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:16:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-48966a2d-5e1d-4a82-afe5-4fb27fd262ea tempest-VolumesActionsTest-731361052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2eda4eaa-c252-4d54-8336-5fb0e3b38079 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:27 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2eda4eaa-c252-4d54-8336-5fb0e3b38079 Jun 29 11:16:27 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:27 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=97,cinder:UPDATE=122,cinder:INSERT=25,cinder:DELETE=9 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:16:27 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-bee38b71-94b8-4fc7-ab1a-d69b4d9daa4b req-6c391bf0-da5b-419e-b08c-9e9fee5bec03 tempest-AttachVolumeNegativeTest-1748370238 None] Terminate volume connection completed successfully. Jun 29 11:16:27 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-bee38b71-94b8-4fc7-ab1a-d69b4d9daa4b req-6c391bf0-da5b-419e-b08c-9e9fee5bec03 tempest-AttachVolumeNegativeTest-1748370238 None] Deleting attachment a8d1cee3-ae0c-40f0-ad15-69c0d08e71f6. {{(pid=93497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 11:16:28 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-48966a2d-5e1d-4a82-afe5-4fb27fd262ea tempest-VolumesActionsTest-731361052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2eda4eaa-c252-4d54-8336-5fb0e3b38079" returned: 0 in 0.959s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-48966a2d-5e1d-4a82-afe5-4fb27fd262ea tempest-VolumesActionsTest-731361052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2eda4eaa-c252-4d54-8336-5fb0e3b38079 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:28 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2eda4eaa-c252-4d54-8336-5fb0e3b38079 Jun 29 11:16:28 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:28 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:16:28 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] Flow 'volume_create_manager' (04c1cfa2-34ef-4043-a875-5921d3e93d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:16:28 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642ba345-bd07-47b5-99bc-62f23b2e84e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:28 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642ba345-bd07-47b5-99bc-62f23b2e84e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-178224574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f76ea656-5ac2-4171-9d7f-661b28ed4f8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='025dc6934a7942cfbae13bc49bd1ae21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:16:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:16:29Z,use_quota=True,user_id='7c8a0aa24aa0446da5bcbe209f365d25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:28 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1707653a-69f6-4681-89a8-8ec69dd5f747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:28 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1707653a-69f6-4681-89a8-8ec69dd5f747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:28 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8204bd7-57e1-469d-ad62-5ad77d30e057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:28 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8204bd7-57e1-469d-ad62-5ad77d30e057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f76ea656-5ac2-4171-9d7f-661b28ed4f8e', 'volume_name': 'volume-f76ea656-5ac2-4171-9d7f-661b28ed4f8e', 'volume_size': 2}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:28 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348981da-3831-4d7d-b8e4-a969738b5ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:28 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348981da-3831-4d7d-b8e4-a969738b5ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:28 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e65b2550-5599-4fb5-9373-f82e3ea4d16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:28 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] Volume f76ea656-5ac2-4171-9d7f-661b28ed4f8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f76ea656-5ac2-4171-9d7f-661b28ed4f8e', 'volume_size': 2} Jun 29 11:16:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:28 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-178224574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f76ea656-5ac2-4171-9d7f-661b28ed4f8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='025dc6934a7942cfbae13bc49bd1ae21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:16:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:16:29Z,use_quota=True,user_id='7c8a0aa24aa0446da5bcbe209f365d25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:16:28 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] Creating volume f76ea656-5ac2-4171-9d7f-661b28ed4f8e {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:16:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:28 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:16:28 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:16:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:28 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:16:28 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:16:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f76ea656-5ac2-4171-9d7f-661b28ed4f8e 2147483648 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:28 devstack sudo[105290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f76ea656-5ac2-4171-9d7f-661b28ed4f8e 2147483648 Jun 29 11:16:28 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:28 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-48966a2d-5e1d-4a82-afe5-4fb27fd262ea tempest-VolumesActionsTest-731361052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2eda4eaa-c252-4d54-8336-5fb0e3b38079" returned: 0 in 0.814s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:29 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-48966a2d-5e1d-4a82-afe5-4fb27fd262ea tempest-VolumesActionsTest-731361052 None] Lock "cinder-quobyte-2eda4eaa-c252-4d54-8336-5fb0e3b38079" released by "delete_volume" :: held 1.861s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:29 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-48966a2d-5e1d-4a82-afe5-4fb27fd262ea tempest-VolumesActionsTest-731361052 None] Created reservations ['089c7ee4-c53d-4252-96b9-820902afaad4', 'b25169cc-ae7b-4337-9106-e34577b34fd1', 'a50ccabe-8c1a-4c29-85d5-750d9fbe8eed', 'ef9e9025-648c-42bc-95b1-e9562a04e881'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:16:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-48966a2d-5e1d-4a82-afe5-4fb27fd262ea tempest-VolumesActionsTest-731361052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-48966a2d-5e1d-4a82-afe5-4fb27fd262ea tempest-VolumesActionsTest-731361052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:29 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-48966a2d-5e1d-4a82-afe5-4fb27fd262ea tempest-VolumesActionsTest-731361052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:16:29 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-48966a2d-5e1d-4a82-afe5-4fb27fd262ea tempest-VolumesActionsTest-731361052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:16:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-48966a2d-5e1d-4a82-afe5-4fb27fd262ea tempest-VolumesActionsTest-731361052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-48966a2d-5e1d-4a82-afe5-4fb27fd262ea tempest-VolumesActionsTest-731361052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:29 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:16:29 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:29 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f76ea656-5ac2-4171-9d7f-661b28ed4f8e 2147483648" returned: 0 in 1.302s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f76ea656-5ac2-4171-9d7f-661b28ed4f8e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:30 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f76ea656-5ac2-4171-9d7f-661b28ed4f8e Jun 29 11:16:30 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:30 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:16:30 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:30 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] Flow 'volume_create_manager' (976614b6-b798-41af-956d-7439c8868457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:16:30 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba2ea7b7-e6ad-476b-bc5e-8209ca412d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-48966a2d-5e1d-4a82-afe5-4fb27fd262ea tempest-VolumesActionsTest-731361052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.189s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:30 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-48966a2d-5e1d-4a82-afe5-4fb27fd262ea tempest-VolumesActionsTest-731361052 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:16:30 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-48966a2d-5e1d-4a82-afe5-4fb27fd262ea tempest-VolumesActionsTest-731361052 None] Deleted volume successfully. Jun 29 11:16:30 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba2ea7b7-e6ad-476b-bc5e-8209ca412d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-684204906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59398302-45a7-47a5-9dd3-88672ab24a24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4661f8719a84d649e627bc24cce04ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:16:30Z,use_quota=True,user_id='92b22b12f23e4c6fb93da99ac422fce5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:30 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57bc65b3-9829-4387-94cb-62e6cc28d97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:30 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57bc65b3-9829-4387-94cb-62e6cc28d97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:30 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7db42023-68d6-4b0f-a76f-3f0ed893e829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:30 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7db42023-68d6-4b0f-a76f-3f0ed893e829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59398302-45a7-47a5-9dd3-88672ab24a24', 'volume_name': 'volume-59398302-45a7-47a5-9dd3-88672ab24a24', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:30 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9e4cd9-418f-4ac7-a4cf-a001f83f1d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:30 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9e4cd9-418f-4ac7-a4cf-a001f83f1d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:30 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (331fd12d-0311-406f-8e09-f1c1c554804e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:30 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] Volume 59398302-45a7-47a5-9dd3-88672ab24a24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59398302-45a7-47a5-9dd3-88672ab24a24', 'volume_size': 1} Jun 29 11:16:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:30 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-48966a2d-5e1d-4a82-afe5-4fb27fd262ea tempest-VolumesActionsTest-731361052 None] Lock "cinder-2eda4eaa-c252-4d54-8336-5fb0e3b38079-delete_volume" released by "delete_volume" :: held 3.484s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:30 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f76ea656-5ac2-4171-9d7f-661b28ed4f8e" returned: 0 in 0.908s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:30 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] <== create_volume: return (2294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:16:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.296s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.420s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:30 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-684204906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59398302-45a7-47a5-9dd3-88672ab24a24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4661f8719a84d649e627bc24cce04ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:16:30Z,use_quota=True,user_id='92b22b12f23e4c6fb93da99ac422fce5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:16:30 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] Creating volume 59398302-45a7-47a5-9dd3-88672ab24a24 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:16:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:30 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:16:30 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:16:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:30 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:16:30 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:16:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-59398302-45a7-47a5-9dd3-88672ab24a24 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:31 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-59398302-45a7-47a5-9dd3-88672ab24a24 1073741824 Jun 29 11:16:31 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e65b2550-5599-4fb5-9373-f82e3ea4d16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f76ea656-5ac2-4171-9d7f-661b28ed4f8e', 'volume_size': 2}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:31 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2da4c9d3-4141-4a98-a8bd-545aa0b00f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:31 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:31 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] Volume volume-f76ea656-5ac2-4171-9d7f-661b28ed4f8e (f76ea656-5ac2-4171-9d7f-661b28ed4f8e): created successfully Jun 29 11:16:31 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2da4c9d3-4141-4a98-a8bd-545aa0b00f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:31 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] Flow 'volume_create_manager' (04c1cfa2-34ef-4043-a875-5921d3e93d9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:16:31 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-90aa309b-dd79-4edb-b02a-997f0e195715 tempest-VolumesCloneNegativeTest-133935958 None] Created volume successfully. Jun 29 11:16:32 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-464bacb0-a13d-4156-9986-17bdc79afdc0 tempest-VolumesCloneNegativeTest-133935958 None] Acquiring lock "cinder-f76ea656-5ac2-4171-9d7f-661b28ed4f8e-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:16:32 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-464bacb0-a13d-4156-9986-17bdc79afdc0 tempest-VolumesCloneNegativeTest-133935958 None] Lock "cinder-f76ea656-5ac2-4171-9d7f-661b28ed4f8e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:16:32 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-464bacb0-a13d-4156-9986-17bdc79afdc0 tempest-VolumesCloneNegativeTest-133935958 None] Acquiring lock "cinder-quobyte-f76ea656-5ac2-4171-9d7f-661b28ed4f8e" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:16:32 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-464bacb0-a13d-4156-9986-17bdc79afdc0 tempest-VolumesCloneNegativeTest-133935958 None] Lock "cinder-quobyte-f76ea656-5ac2-4171-9d7f-661b28ed4f8e" acquired by "delete_volume" :: waited 0.021s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:16:32 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[528845fc-a65d-4d04-b376-e8bf315ffed4]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:16:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-464bacb0-a13d-4156-9986-17bdc79afdc0 tempest-VolumesCloneNegativeTest-133935958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f76ea656-5ac2-4171-9d7f-661b28ed4f8e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:32 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f76ea656-5ac2-4171-9d7f-661b28ed4f8e Jun 29 11:16:32 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:32 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-59398302-45a7-47a5-9dd3-88672ab24a24 1073741824" returned: 0 in 1.383s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-59398302-45a7-47a5-9dd3-88672ab24a24 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:32 devstack sudo[105352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-59398302-45a7-47a5-9dd3-88672ab24a24 Jun 29 11:16:32 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:33 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-59398302-45a7-47a5-9dd3-88672ab24a24" returned: 0 in 0.731s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:33 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] <== create_volume: return (2168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:16:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.171s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:33 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (331fd12d-0311-406f-8e09-f1c1c554804e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59398302-45a7-47a5-9dd3-88672ab24a24', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:33 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98fb4c3f-7f0a-4402-a4fe-a80dbb0e910a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:33 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] Volume volume-59398302-45a7-47a5-9dd3-88672ab24a24 (59398302-45a7-47a5-9dd3-88672ab24a24): created successfully Jun 29 11:16:33 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98fb4c3f-7f0a-4402-a4fe-a80dbb0e910a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:33 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] Flow 'volume_create_manager' (976614b6-b798-41af-956d-7439c8868457) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:16:33 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-0704c944-98f4-481e-909b-8050ffceea54 tempest-VolumesActionsTest-138828446 None] Created volume successfully. Jun 29 11:16:33 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-464bacb0-a13d-4156-9986-17bdc79afdc0 tempest-VolumesCloneNegativeTest-133935958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f76ea656-5ac2-4171-9d7f-661b28ed4f8e" returned: 0 in 1.222s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-464bacb0-a13d-4156-9986-17bdc79afdc0 tempest-VolumesCloneNegativeTest-133935958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f76ea656-5ac2-4171-9d7f-661b28ed4f8e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:33 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f76ea656-5ac2-4171-9d7f-661b28ed4f8e Jun 29 11:16:33 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:33 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-dc040726-8c51-4013-adac-974d526a9590 tempest-VolumesActionsTest-731361052 None] Acquiring lock "cinder-59398302-45a7-47a5-9dd3-88672ab24a24-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:16:33 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-dc040726-8c51-4013-adac-974d526a9590 tempest-VolumesActionsTest-731361052 None] Lock "cinder-59398302-45a7-47a5-9dd3-88672ab24a24-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:16:33 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-dc040726-8c51-4013-adac-974d526a9590 tempest-VolumesActionsTest-731361052 None] Acquiring lock "cinder-quobyte-59398302-45a7-47a5-9dd3-88672ab24a24" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:16:33 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-dc040726-8c51-4013-adac-974d526a9590 tempest-VolumesActionsTest-731361052 None] Lock "cinder-quobyte-59398302-45a7-47a5-9dd3-88672ab24a24" acquired by "delete_volume" :: waited 0.025s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:16:33 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51cfdb2-8dd4-4ff6-8eaf-d6cbff29391d]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:16:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dc040726-8c51-4013-adac-974d526a9590 tempest-VolumesActionsTest-731361052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-59398302-45a7-47a5-9dd3-88672ab24a24 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:34 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-59398302-45a7-47a5-9dd3-88672ab24a24 Jun 29 11:16:34 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:34 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-464bacb0-a13d-4156-9986-17bdc79afdc0 tempest-VolumesCloneNegativeTest-133935958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f76ea656-5ac2-4171-9d7f-661b28ed4f8e" returned: 0 in 1.088s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:34 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-464bacb0-a13d-4156-9986-17bdc79afdc0 tempest-VolumesCloneNegativeTest-133935958 None] Lock "cinder-quobyte-f76ea656-5ac2-4171-9d7f-661b28ed4f8e" released by "delete_volume" :: held 2.374s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:34 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-464bacb0-a13d-4156-9986-17bdc79afdc0 tempest-VolumesCloneNegativeTest-133935958 None] Created reservations ['757ff304-0a56-43ae-bdd8-0b2a2693eeac', '1fbc029a-04b5-4b13-add1-bca4d37a4dae', '13392c77-12f9-4f5b-a079-1643b5f760d8', 'c752dcfe-a828-4c0f-9589-e02fb19f6374'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:16:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-464bacb0-a13d-4156-9986-17bdc79afdc0 tempest-VolumesCloneNegativeTest-133935958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-464bacb0-a13d-4156-9986-17bdc79afdc0 tempest-VolumesCloneNegativeTest-133935958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:34 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-464bacb0-a13d-4156-9986-17bdc79afdc0 tempest-VolumesCloneNegativeTest-133935958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:16:34 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-464bacb0-a13d-4156-9986-17bdc79afdc0 tempest-VolumesCloneNegativeTest-133935958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:16:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-464bacb0-a13d-4156-9986-17bdc79afdc0 tempest-VolumesCloneNegativeTest-133935958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-464bacb0-a13d-4156-9986-17bdc79afdc0 tempest-VolumesCloneNegativeTest-133935958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:34 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:16:34 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:34 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dc040726-8c51-4013-adac-974d526a9590 tempest-VolumesActionsTest-731361052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-59398302-45a7-47a5-9dd3-88672ab24a24" returned: 0 in 1.039s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dc040726-8c51-4013-adac-974d526a9590 tempest-VolumesActionsTest-731361052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-59398302-45a7-47a5-9dd3-88672ab24a24 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:34 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-59398302-45a7-47a5-9dd3-88672ab24a24 Jun 29 11:16:34 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:35 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-464bacb0-a13d-4156-9986-17bdc79afdc0 tempest-VolumesCloneNegativeTest-133935958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.792s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:35 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-464bacb0-a13d-4156-9986-17bdc79afdc0 tempest-VolumesCloneNegativeTest-133935958 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:16:35 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-464bacb0-a13d-4156-9986-17bdc79afdc0 tempest-VolumesCloneNegativeTest-133935958 None] Deleted volume successfully. Jun 29 11:16:35 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-464bacb0-a13d-4156-9986-17bdc79afdc0 tempest-VolumesCloneNegativeTest-133935958 None] Lock "cinder-f76ea656-5ac2-4171-9d7f-661b28ed4f8e-delete_volume" released by "delete_volume" :: held 3.460s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:35 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dc040726-8c51-4013-adac-974d526a9590 tempest-VolumesActionsTest-731361052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-59398302-45a7-47a5-9dd3-88672ab24a24" returned: 0 in 0.888s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:35 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-dc040726-8c51-4013-adac-974d526a9590 tempest-VolumesActionsTest-731361052 None] Lock "cinder-quobyte-59398302-45a7-47a5-9dd3-88672ab24a24" released by "delete_volume" :: held 2.000s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:35 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-dc040726-8c51-4013-adac-974d526a9590 tempest-VolumesActionsTest-731361052 None] Created reservations ['60a22d16-cf1f-435e-978e-68c45a470998', '931e7316-fc2b-41b8-aa6b-58af08bd87fb', '919f94b4-1cfd-49f3-bf57-bb2e18d7c0c0', '3faf801f-9b8c-4ef8-be53-c65b01121954'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:16:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-dc040726-8c51-4013-adac-974d526a9590 tempest-VolumesActionsTest-731361052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-dc040726-8c51-4013-adac-974d526a9590 tempest-VolumesActionsTest-731361052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:35 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-dc040726-8c51-4013-adac-974d526a9590 tempest-VolumesActionsTest-731361052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:16:35 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-dc040726-8c51-4013-adac-974d526a9590 tempest-VolumesActionsTest-731361052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:16:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-dc040726-8c51-4013-adac-974d526a9590 tempest-VolumesActionsTest-731361052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dc040726-8c51-4013-adac-974d526a9590 tempest-VolumesActionsTest-731361052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:35 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:16:35 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:36 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dc040726-8c51-4013-adac-974d526a9590 tempest-VolumesActionsTest-731361052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.819s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:36 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-dc040726-8c51-4013-adac-974d526a9590 tempest-VolumesActionsTest-731361052 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:16:36 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-dc040726-8c51-4013-adac-974d526a9590 tempest-VolumesActionsTest-731361052 None] Deleted volume successfully. Jun 29 11:16:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-dc040726-8c51-4013-adac-974d526a9590 tempest-VolumesActionsTest-731361052 None] Lock "cinder-59398302-45a7-47a5-9dd3-88672ab24a24-delete_volume" released by "delete_volume" :: held 3.101s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:36 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:16:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] Flow 'volume_create_manager' (ca841a34-65d5-43a2-bf7f-8e50d798b8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:16:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce44606-292d-4c18-ad7d-246545da8af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce44606-292d-4c18-ad7d-246545da8af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-31991094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24123605-146f-464b-8b75-cc5c189be08b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4661f8719a84d649e627bc24cce04ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:16:37Z,use_quota=True,user_id='92b22b12f23e4c6fb93da99ac422fce5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddba26ef-de8c-43d3-9209-f1a84671bd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:37 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddba26ef-de8c-43d3-9209-f1a84671bd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:37 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e426f143-91fe-414a-b0fe-66a034af6389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:37 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e426f143-91fe-414a-b0fe-66a034af6389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24123605-146f-464b-8b75-cc5c189be08b', 'volume_name': 'volume-24123605-146f-464b-8b75-cc5c189be08b', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:37 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb61914-b205-455f-89c8-bcd80d421281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:37 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb61914-b205-455f-89c8-bcd80d421281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:37 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (901eecf6-7c79-4d0b-a6f4-999a94f7dacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:37 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] Volume 24123605-146f-464b-8b75-cc5c189be08b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24123605-146f-464b-8b75-cc5c189be08b', 'volume_size': 1} Jun 29 11:16:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:37 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-31991094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24123605-146f-464b-8b75-cc5c189be08b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4661f8719a84d649e627bc24cce04ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:16:37Z,use_quota=True,user_id='92b22b12f23e4c6fb93da99ac422fce5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:16:37 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] Creating volume 24123605-146f-464b-8b75-cc5c189be08b {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:16:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:37 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:16:37 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:16:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:37 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:16:37 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:16:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-24123605-146f-464b-8b75-cc5c189be08b 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:37 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-24123605-146f-464b-8b75-cc5c189be08b 1073741824 Jun 29 11:16:37 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:38 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-24123605-146f-464b-8b75-cc5c189be08b 1073741824" returned: 0 in 1.172s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:38 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:INSERT=32,cinder:UPDATE=139,cinder:SELECT=117,cinder:DELETE=11 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:16:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-24123605-146f-464b-8b75-cc5c189be08b {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:38 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-24123605-146f-464b-8b75-cc5c189be08b Jun 29 11:16:38 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:39 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-24123605-146f-464b-8b75-cc5c189be08b" returned: 0 in 0.968s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:39 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] <== create_volume: return (2207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:16:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.209s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (901eecf6-7c79-4d0b-a6f4-999a94f7dacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24123605-146f-464b-8b75-cc5c189be08b', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e1a929-320e-4f96-adee-e3e45167c6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:39 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] Volume volume-24123605-146f-464b-8b75-cc5c189be08b (24123605-146f-464b-8b75-cc5c189be08b): created successfully Jun 29 11:16:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e1a929-320e-4f96-adee-e3e45167c6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] Flow 'volume_create_manager' (ca841a34-65d5-43a2-bf7f-8e50d798b8ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:16:39 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-2ffc8817-4ae3-4c29-9245-fb842a8e476c tempest-VolumesActionsTest-138828446 None] Created volume successfully. Jun 29 11:16:39 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8b2bf852-f41e-4925-9f8e-055675386844 tempest-AttachVolumeNegativeTest-1748370238 None] Acquiring lock "cinder-00e72059-932a-4766-a9e5-da8afec02870-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:16:39 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8b2bf852-f41e-4925-9f8e-055675386844 tempest-AttachVolumeNegativeTest-1748370238 None] Lock "cinder-00e72059-932a-4766-a9e5-da8afec02870-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:16:39 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8b2bf852-f41e-4925-9f8e-055675386844 tempest-AttachVolumeNegativeTest-1748370238 None] Acquiring lock "cinder-quobyte-00e72059-932a-4766-a9e5-da8afec02870" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:16:39 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8b2bf852-f41e-4925-9f8e-055675386844 tempest-AttachVolumeNegativeTest-1748370238 None] Lock "cinder-quobyte-00e72059-932a-4766-a9e5-da8afec02870" acquired by "delete_volume" :: waited 0.025s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:16:39 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d654bb98-5b3f-4033-8b7f-bc01f891ab03]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:16:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8b2bf852-f41e-4925-9f8e-055675386844 tempest-AttachVolumeNegativeTest-1748370238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-00e72059-932a-4766-a9e5-da8afec02870 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:39 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-00e72059-932a-4766-a9e5-da8afec02870 Jun 29 11:16:39 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:40 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8b2bf852-f41e-4925-9f8e-055675386844 tempest-AttachVolumeNegativeTest-1748370238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-00e72059-932a-4766-a9e5-da8afec02870" returned: 0 in 0.910s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8b2bf852-f41e-4925-9f8e-055675386844 tempest-AttachVolumeNegativeTest-1748370238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-00e72059-932a-4766-a9e5-da8afec02870 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:40 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-00e72059-932a-4766-a9e5-da8afec02870 Jun 29 11:16:40 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:40 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:16:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] Flow 'volume_create_manager' (925cf1db-f490-4c40-bd87-17c326a61e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:16:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (561dd697-a966-48bb-8bcc-f3fa82bf73c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (561dd697-a966-48bb-8bcc-f3fa82bf73c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1442956821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28462972-c58f-464b-9e54-c10a4dc52242,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='61e86266cdf3432fa02a008cf313fac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:16:40Z,use_quota=True,user_id='77e05219ad094f72a78097d245f210a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5cf54e-6b4f-49f3-8507-3bfa78ec7bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5cf54e-6b4f-49f3-8507-3bfa78ec7bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5886bb1-b2ce-4891-86ca-8f36ff02809b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5886bb1-b2ce-4891-86ca-8f36ff02809b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28462972-c58f-464b-9e54-c10a4dc52242', 'volume_name': 'volume-28462972-c58f-464b-9e54-c10a4dc52242', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f29b61-08e8-48dd-9372-4282d085003b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f29b61-08e8-48dd-9372-4282d085003b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b704084-2411-45d5-b609-0314caae63d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:40 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] Volume 28462972-c58f-464b-9e54-c10a4dc52242: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28462972-c58f-464b-9e54-c10a4dc52242', 'volume_size': 1} Jun 29 11:16:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:40 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1442956821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28462972-c58f-464b-9e54-c10a4dc52242,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='61e86266cdf3432fa02a008cf313fac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:16:40Z,use_quota=True,user_id='77e05219ad094f72a78097d245f210a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:16:40 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] Creating volume 28462972-c58f-464b-9e54-c10a4dc52242 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:16:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:40 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:16:40 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:16:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:40 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:16:40 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:16:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-28462972-c58f-464b-9e54-c10a4dc52242 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:40 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-28462972-c58f-464b-9e54-c10a4dc52242 1073741824 Jun 29 11:16:40 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:41 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-19785acd-7fe3-42a1-bf8c-ba6e2704e950 tempest-VolumesActionsTest-138828446 None] Acquiring lock "cinder-24123605-146f-464b-8b75-cc5c189be08b-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:16:41 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-19785acd-7fe3-42a1-bf8c-ba6e2704e950 tempest-VolumesActionsTest-138828446 None] Lock "cinder-24123605-146f-464b-8b75-cc5c189be08b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:16:41 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-19785acd-7fe3-42a1-bf8c-ba6e2704e950 tempest-VolumesActionsTest-138828446 None] Acquiring lock "cinder-quobyte-24123605-146f-464b-8b75-cc5c189be08b" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:16:41 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-19785acd-7fe3-42a1-bf8c-ba6e2704e950 tempest-VolumesActionsTest-138828446 None] Lock "cinder-quobyte-24123605-146f-464b-8b75-cc5c189be08b" acquired by "delete_volume" :: waited 0.023s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:16:41 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afab1fc-aecc-462e-883d-98dce4974744]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:16:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-19785acd-7fe3-42a1-bf8c-ba6e2704e950 tempest-VolumesActionsTest-138828446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-24123605-146f-464b-8b75-cc5c189be08b {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:41 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8b2bf852-f41e-4925-9f8e-055675386844 tempest-AttachVolumeNegativeTest-1748370238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-00e72059-932a-4766-a9e5-da8afec02870" returned: 0 in 0.923s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:41 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8b2bf852-f41e-4925-9f8e-055675386844 tempest-AttachVolumeNegativeTest-1748370238 None] Lock "cinder-quobyte-00e72059-932a-4766-a9e5-da8afec02870" released by "delete_volume" :: held 1.893s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:41 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-8b2bf852-f41e-4925-9f8e-055675386844 tempest-AttachVolumeNegativeTest-1748370238 None] Created reservations ['5482429e-fc11-4296-b5cf-2697542dbe6d', 'eae94e1c-cea1-49a0-a28c-791a86823f4f', 'affd5516-789f-4b9a-8a68-8c2d25bde3c7', 'ab4301d7-b3d3-49fa-b5f1-00b7a3bcfa2d'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:16:41 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-24123605-146f-464b-8b75-cc5c189be08b Jun 29 11:16:41 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8b2bf852-f41e-4925-9f8e-055675386844 tempest-AttachVolumeNegativeTest-1748370238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8b2bf852-f41e-4925-9f8e-055675386844 tempest-AttachVolumeNegativeTest-1748370238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:41 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8b2bf852-f41e-4925-9f8e-055675386844 tempest-AttachVolumeNegativeTest-1748370238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:16:41 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8b2bf852-f41e-4925-9f8e-055675386844 tempest-AttachVolumeNegativeTest-1748370238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:16:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8b2bf852-f41e-4925-9f8e-055675386844 tempest-AttachVolumeNegativeTest-1748370238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8b2bf852-f41e-4925-9f8e-055675386844 tempest-AttachVolumeNegativeTest-1748370238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:41 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:16:41 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:41 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fbbb5c4c-fa3b-4d5e-922f-ed6611943d34 tempest-AttachVolumeNegativeTest-1748370238 None] Acquiring lock "cinder-63c2dc4b-bd08-4207-95d0-91ff88cb1b5d-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:16:41 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-28462972-c58f-464b-9e54-c10a4dc52242 1073741824" returned: 0 in 1.262s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:41 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fbbb5c4c-fa3b-4d5e-922f-ed6611943d34 tempest-AttachVolumeNegativeTest-1748370238 None] Lock "cinder-63c2dc4b-bd08-4207-95d0-91ff88cb1b5d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:16:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-28462972-c58f-464b-9e54-c10a4dc52242 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:41 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fbbb5c4c-fa3b-4d5e-922f-ed6611943d34 tempest-AttachVolumeNegativeTest-1748370238 None] Acquiring lock "cinder-quobyte-63c2dc4b-bd08-4207-95d0-91ff88cb1b5d" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:16:42 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fbbb5c4c-fa3b-4d5e-922f-ed6611943d34 tempest-AttachVolumeNegativeTest-1748370238 None] Lock "cinder-quobyte-63c2dc4b-bd08-4207-95d0-91ff88cb1b5d" acquired by "delete_volume" :: waited 0.021s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:16:42 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-28462972-c58f-464b-9e54-c10a4dc52242 Jun 29 11:16:42 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:42 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5081290d-3be7-4642-8267-b55e368877b1]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:16:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fbbb5c4c-fa3b-4d5e-922f-ed6611943d34 tempest-AttachVolumeNegativeTest-1748370238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-63c2dc4b-bd08-4207-95d0-91ff88cb1b5d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:42 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-63c2dc4b-bd08-4207-95d0-91ff88cb1b5d Jun 29 11:16:42 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8b2bf852-f41e-4925-9f8e-055675386844 tempest-AttachVolumeNegativeTest-1748370238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.801s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:42 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:42 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-8b2bf852-f41e-4925-9f8e-055675386844 tempest-AttachVolumeNegativeTest-1748370238 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:16:42 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-8b2bf852-f41e-4925-9f8e-055675386844 tempest-AttachVolumeNegativeTest-1748370238 None] Deleted volume successfully. Jun 29 11:16:42 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8b2bf852-f41e-4925-9f8e-055675386844 tempest-AttachVolumeNegativeTest-1748370238 None] Lock "cinder-00e72059-932a-4766-a9e5-da8afec02870-delete_volume" released by "delete_volume" :: held 3.008s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:42 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-19785acd-7fe3-42a1-bf8c-ba6e2704e950 tempest-VolumesActionsTest-138828446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-24123605-146f-464b-8b75-cc5c189be08b" returned: 0 in 1.514s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-19785acd-7fe3-42a1-bf8c-ba6e2704e950 tempest-VolumesActionsTest-138828446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-24123605-146f-464b-8b75-cc5c189be08b {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:42 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-24123605-146f-464b-8b75-cc5c189be08b Jun 29 11:16:42 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:43 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-28462972-c58f-464b-9e54-c10a4dc52242" returned: 0 in 1.167s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:43 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] <== create_volume: return (2525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:16:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.529s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b704084-2411-45d5-b609-0314caae63d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28462972-c58f-464b-9e54-c10a4dc52242', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (573a7a14-a0d6-4012-8cf0-08dd00c04aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:43 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] Volume volume-28462972-c58f-464b-9e54-c10a4dc52242 (28462972-c58f-464b-9e54-c10a4dc52242): created successfully Jun 29 11:16:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (573a7a14-a0d6-4012-8cf0-08dd00c04aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] Flow 'volume_create_manager' (925cf1db-f490-4c40-bd87-17c326a61e96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:16:43 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:43 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-00247c9a-ac54-4ada-b9ce-7d9c0a72ad3b tempest-VolumesGetTest-1307359977 None] Created volume successfully. Jun 29 11:16:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fbbb5c4c-fa3b-4d5e-922f-ed6611943d34 tempest-AttachVolumeNegativeTest-1748370238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-63c2dc4b-bd08-4207-95d0-91ff88cb1b5d" returned: 0 in 1.175s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fbbb5c4c-fa3b-4d5e-922f-ed6611943d34 tempest-AttachVolumeNegativeTest-1748370238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-63c2dc4b-bd08-4207-95d0-91ff88cb1b5d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:43 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-63c2dc4b-bd08-4207-95d0-91ff88cb1b5d Jun 29 11:16:43 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:43 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-19785acd-7fe3-42a1-bf8c-ba6e2704e950 tempest-VolumesActionsTest-138828446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-24123605-146f-464b-8b75-cc5c189be08b" returned: 0 in 0.789s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:43 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-19785acd-7fe3-42a1-bf8c-ba6e2704e950 tempest-VolumesActionsTest-138828446 None] Lock "cinder-quobyte-24123605-146f-464b-8b75-cc5c189be08b" released by "delete_volume" :: held 2.371s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:43 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-19785acd-7fe3-42a1-bf8c-ba6e2704e950 tempest-VolumesActionsTest-138828446 None] Created reservations ['d2f1d241-c82c-47ff-a8d5-e972e1a524bf', '7488259b-c953-43b7-8fc7-bb91246b3c83', '280e7f1f-7626-4e4f-b22a-5945ea17be34', 'daf84fc2-9738-461d-9c23-30a2d3a00af5'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:16:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-19785acd-7fe3-42a1-bf8c-ba6e2704e950 tempest-VolumesActionsTest-138828446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-19785acd-7fe3-42a1-bf8c-ba6e2704e950 tempest-VolumesActionsTest-138828446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:43 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-19785acd-7fe3-42a1-bf8c-ba6e2704e950 tempest-VolumesActionsTest-138828446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:16:43 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-19785acd-7fe3-42a1-bf8c-ba6e2704e950 tempest-VolumesActionsTest-138828446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:16:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-19785acd-7fe3-42a1-bf8c-ba6e2704e950 tempest-VolumesActionsTest-138828446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-19785acd-7fe3-42a1-bf8c-ba6e2704e950 tempest-VolumesActionsTest-138828446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:43 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:16:43 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:43 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fbbb5c4c-fa3b-4d5e-922f-ed6611943d34 tempest-AttachVolumeNegativeTest-1748370238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-63c2dc4b-bd08-4207-95d0-91ff88cb1b5d" returned: 0 in 0.714s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:43 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fbbb5c4c-fa3b-4d5e-922f-ed6611943d34 tempest-AttachVolumeNegativeTest-1748370238 None] Lock "cinder-quobyte-63c2dc4b-bd08-4207-95d0-91ff88cb1b5d" released by "delete_volume" :: held 1.953s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:44 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-fbbb5c4c-fa3b-4d5e-922f-ed6611943d34 tempest-AttachVolumeNegativeTest-1748370238 None] Created reservations ['d84b2a96-f6c9-4ebc-b204-c12a41a5ce72', '9bdcdfa1-7112-4f8a-a96c-938080494f0b', '29f5946b-9878-43f5-807d-89130830d94c', 'b661c20d-8aff-487b-a457-9d8531bf1f67'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:16:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fbbb5c4c-fa3b-4d5e-922f-ed6611943d34 tempest-AttachVolumeNegativeTest-1748370238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fbbb5c4c-fa3b-4d5e-922f-ed6611943d34 tempest-AttachVolumeNegativeTest-1748370238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:44 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-fbbb5c4c-fa3b-4d5e-922f-ed6611943d34 tempest-AttachVolumeNegativeTest-1748370238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:16:44 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-fbbb5c4c-fa3b-4d5e-922f-ed6611943d34 tempest-AttachVolumeNegativeTest-1748370238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:16:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fbbb5c4c-fa3b-4d5e-922f-ed6611943d34 tempest-AttachVolumeNegativeTest-1748370238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fbbb5c4c-fa3b-4d5e-922f-ed6611943d34 tempest-AttachVolumeNegativeTest-1748370238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:44 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:16:44 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:44 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-153a6ab3-8210-4b5c-8bbd-5e4ea33580d8 tempest-AttachVolumeNegativeTest-1748370238 None] Acquiring lock "cinder-3a967540-94c4-4de5-9499-b9508eb0a5fb-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:16:44 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-153a6ab3-8210-4b5c-8bbd-5e4ea33580d8 tempest-AttachVolumeNegativeTest-1748370238 None] Lock "cinder-3a967540-94c4-4de5-9499-b9508eb0a5fb-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:16:44 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-153a6ab3-8210-4b5c-8bbd-5e4ea33580d8 tempest-AttachVolumeNegativeTest-1748370238 None] Acquiring lock "cinder-quobyte-3a967540-94c4-4de5-9499-b9508eb0a5fb" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:16:44 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-153a6ab3-8210-4b5c-8bbd-5e4ea33580d8 tempest-AttachVolumeNegativeTest-1748370238 None] Lock "cinder-quobyte-3a967540-94c4-4de5-9499-b9508eb0a5fb" acquired by "delete_volume" :: waited 0.053s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:16:44 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a092964-a65e-4704-aa2c-23410f99a64f]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:16:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-153a6ab3-8210-4b5c-8bbd-5e4ea33580d8 tempest-AttachVolumeNegativeTest-1748370238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-3a967540-94c4-4de5-9499-b9508eb0a5fb {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:44 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-3a967540-94c4-4de5-9499-b9508eb0a5fb Jun 29 11:16:44 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:45 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:16:45 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] Flow 'volume_create_manager' (22b32e35-c885-4c67-946d-e245a9ed0646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:16:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2621bc57-5108-4156-bb2f-362f20346f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-19785acd-7fe3-42a1-bf8c-ba6e2704e950 tempest-VolumesActionsTest-138828446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.262s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:45 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-19785acd-7fe3-42a1-bf8c-ba6e2704e950 tempest-VolumesActionsTest-138828446 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:16:45 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-19785acd-7fe3-42a1-bf8c-ba6e2704e950 tempest-VolumesActionsTest-138828446 None] Deleted volume successfully. Jun 29 11:16:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2621bc57-5108-4156-bb2f-362f20346f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:16:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1897932744',display_name='tempest-VolumesGetTest-Volume-1040366559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4de8ed3-80b2-463f-a747-bcad99dfdff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e86266cdf3432fa02a008cf313fac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:16:45Z,use_quota=True,user_id='77e05219ad094f72a78097d245f210a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a61e25cd-8a76-4546-90f6-a501fa602cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a61e25cd-8a76-4546-90f6-a501fa602cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72bad151-3991-4dbd-9965-3d1ef8e8e4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72bad151-3991-4dbd-9965-3d1ef8e8e4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4de8ed3-80b2-463f-a747-bcad99dfdff1', 'volume_name': 'volume-b4de8ed3-80b2-463f-a747-bcad99dfdff1', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5553173d-be6c-4141-bd26-2570328cf9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5553173d-be6c-4141-bd26-2570328cf9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b47b3217-d0fd-462e-95eb-4b8b05771448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:45 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] Volume b4de8ed3-80b2-463f-a747-bcad99dfdff1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4de8ed3-80b2-463f-a747-bcad99dfdff1', 'volume_size': 1} Jun 29 11:16:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:45 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:16:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1897932744',display_name='tempest-VolumesGetTest-Volume-1040366559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4de8ed3-80b2-463f-a747-bcad99dfdff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e86266cdf3432fa02a008cf313fac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:16:45Z,use_quota=True,user_id='77e05219ad094f72a78097d245f210a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:16:45 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] Creating volume b4de8ed3-80b2-463f-a747-bcad99dfdff1 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:16:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:45 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:16:45 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:16:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:45 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:16:45 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:16:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b4de8ed3-80b2-463f-a747-bcad99dfdff1 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:45 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:45 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-19785acd-7fe3-42a1-bf8c-ba6e2704e950 tempest-VolumesActionsTest-138828446 None] Lock "cinder-24123605-146f-464b-8b75-cc5c189be08b-delete_volume" released by "delete_volume" :: held 4.040s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fbbb5c4c-fa3b-4d5e-922f-ed6611943d34 tempest-AttachVolumeNegativeTest-1748370238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.063s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:45 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-fbbb5c4c-fa3b-4d5e-922f-ed6611943d34 tempest-AttachVolumeNegativeTest-1748370238 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:16:45 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b4de8ed3-80b2-463f-a747-bcad99dfdff1 1073741824 Jun 29 11:16:45 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:45 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-fbbb5c4c-fa3b-4d5e-922f-ed6611943d34 tempest-AttachVolumeNegativeTest-1748370238 None] Deleted volume successfully. Jun 29 11:16:45 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fbbb5c4c-fa3b-4d5e-922f-ed6611943d34 tempest-AttachVolumeNegativeTest-1748370238 None] Lock "cinder-63c2dc4b-bd08-4207-95d0-91ff88cb1b5d-delete_volume" released by "delete_volume" :: held 3.394s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:45 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-153a6ab3-8210-4b5c-8bbd-5e4ea33580d8 tempest-AttachVolumeNegativeTest-1748370238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-3a967540-94c4-4de5-9499-b9508eb0a5fb" returned: 0 in 1.205s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-153a6ab3-8210-4b5c-8bbd-5e4ea33580d8 tempest-AttachVolumeNegativeTest-1748370238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-3a967540-94c4-4de5-9499-b9508eb0a5fb {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:45 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-3a967540-94c4-4de5-9499-b9508eb0a5fb Jun 29 11:16:45 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:46 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b4de8ed3-80b2-463f-a747-bcad99dfdff1 1073741824" returned: 0 in 1.324s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b4de8ed3-80b2-463f-a747-bcad99dfdff1 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:46 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b4de8ed3-80b2-463f-a747-bcad99dfdff1 Jun 29 11:16:46 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-153a6ab3-8210-4b5c-8bbd-5e4ea33580d8 tempest-AttachVolumeNegativeTest-1748370238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-3a967540-94c4-4de5-9499-b9508eb0a5fb" returned: 0 in 0.813s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:46 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:46 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-153a6ab3-8210-4b5c-8bbd-5e4ea33580d8 tempest-AttachVolumeNegativeTest-1748370238 None] Lock "cinder-quobyte-3a967540-94c4-4de5-9499-b9508eb0a5fb" released by "delete_volume" :: held 2.122s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:46 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-153a6ab3-8210-4b5c-8bbd-5e4ea33580d8 tempest-AttachVolumeNegativeTest-1748370238 None] Created reservations ['d1fd30cf-feae-47b4-bffc-32d98411b14f', 'f2063aa3-36cf-4c3d-a1fd-fa6c4c458050', '501609e0-70fb-42b2-9993-3df0c1f3251b', '498b61f0-0434-4dfc-a817-2c401b275b53'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:16:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-153a6ab3-8210-4b5c-8bbd-5e4ea33580d8 tempest-AttachVolumeNegativeTest-1748370238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-153a6ab3-8210-4b5c-8bbd-5e4ea33580d8 tempest-AttachVolumeNegativeTest-1748370238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-153a6ab3-8210-4b5c-8bbd-5e4ea33580d8 tempest-AttachVolumeNegativeTest-1748370238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:16:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-153a6ab3-8210-4b5c-8bbd-5e4ea33580d8 tempest-AttachVolumeNegativeTest-1748370238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:16:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-153a6ab3-8210-4b5c-8bbd-5e4ea33580d8 tempest-AttachVolumeNegativeTest-1748370238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-153a6ab3-8210-4b5c-8bbd-5e4ea33580d8 tempest-AttachVolumeNegativeTest-1748370238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:47 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:16:47 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:47 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b4de8ed3-80b2-463f-a747-bcad99dfdff1" returned: 0 in 0.899s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] <== create_volume: return (2286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:16:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.291s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b47b3217-d0fd-462e-95eb-4b8b05771448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4de8ed3-80b2-463f-a747-bcad99dfdff1', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c869ca32-2e5d-484f-b282-e67b0ac182ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:47 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] Volume volume-b4de8ed3-80b2-463f-a747-bcad99dfdff1 (b4de8ed3-80b2-463f-a747-bcad99dfdff1): created successfully Jun 29 11:16:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c869ca32-2e5d-484f-b282-e67b0ac182ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] Flow 'volume_create_manager' (22b32e35-c885-4c67-946d-e245a9ed0646) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:16:47 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-617f4ffe-db5b-421f-8e38-f97a0e2ea906 tempest-VolumesGetTest-1307359977 None] Created volume successfully. Jun 29 11:16:47 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-153a6ab3-8210-4b5c-8bbd-5e4ea33580d8 tempest-AttachVolumeNegativeTest-1748370238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.751s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:47 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-153a6ab3-8210-4b5c-8bbd-5e4ea33580d8 tempest-AttachVolumeNegativeTest-1748370238 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:16:47 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-153a6ab3-8210-4b5c-8bbd-5e4ea33580d8 tempest-AttachVolumeNegativeTest-1748370238 None] Deleted volume successfully. Jun 29 11:16:47 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-153a6ab3-8210-4b5c-8bbd-5e4ea33580d8 tempest-AttachVolumeNegativeTest-1748370238 None] Lock "cinder-3a967540-94c4-4de5-9499-b9508eb0a5fb-delete_volume" released by "delete_volume" :: held 3.278s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:48 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-6f61f91c-a578-440e-91d3-d4db75f1419f tempest-VolumesGetTest-1307359977 None] Acquiring lock "cinder-b4de8ed3-80b2-463f-a747-bcad99dfdff1-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:16:48 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-6f61f91c-a578-440e-91d3-d4db75f1419f tempest-VolumesGetTest-1307359977 None] Lock "cinder-b4de8ed3-80b2-463f-a747-bcad99dfdff1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:16:48 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-6f61f91c-a578-440e-91d3-d4db75f1419f tempest-VolumesGetTest-1307359977 None] Acquiring lock "cinder-quobyte-b4de8ed3-80b2-463f-a747-bcad99dfdff1" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:16:48 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-6f61f91c-a578-440e-91d3-d4db75f1419f tempest-VolumesGetTest-1307359977 None] Lock "cinder-quobyte-b4de8ed3-80b2-463f-a747-bcad99dfdff1" acquired by "delete_volume" :: waited 0.015s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:16:48 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6d55fd-c15c-4444-9912-3df746b4484d]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:16:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6f61f91c-a578-440e-91d3-d4db75f1419f tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b4de8ed3-80b2-463f-a747-bcad99dfdff1 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:48 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b4de8ed3-80b2-463f-a747-bcad99dfdff1 Jun 29 11:16:48 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:49 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6f61f91c-a578-440e-91d3-d4db75f1419f tempest-VolumesGetTest-1307359977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b4de8ed3-80b2-463f-a747-bcad99dfdff1" returned: 0 in 0.959s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6f61f91c-a578-440e-91d3-d4db75f1419f tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b4de8ed3-80b2-463f-a747-bcad99dfdff1 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:49 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b4de8ed3-80b2-463f-a747-bcad99dfdff1 Jun 29 11:16:49 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:50 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6f61f91c-a578-440e-91d3-d4db75f1419f tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b4de8ed3-80b2-463f-a747-bcad99dfdff1" returned: 0 in 0.992s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:50 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-6f61f91c-a578-440e-91d3-d4db75f1419f tempest-VolumesGetTest-1307359977 None] Lock "cinder-quobyte-b4de8ed3-80b2-463f-a747-bcad99dfdff1" released by "delete_volume" :: held 2.010s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:50 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-6f61f91c-a578-440e-91d3-d4db75f1419f tempest-VolumesGetTest-1307359977 None] Created reservations ['5e8d39c8-53a4-4f91-a973-ea3d06b0aefd', '5d191cfd-54dd-499b-b5a3-5280fc090f58', 'f9c7b4b9-f49f-4e62-85bf-f41d25e8f563', '173468cc-083f-42d2-a23d-985bc8602b37'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:16:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-6f61f91c-a578-440e-91d3-d4db75f1419f tempest-VolumesGetTest-1307359977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-6f61f91c-a578-440e-91d3-d4db75f1419f tempest-VolumesGetTest-1307359977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-6f61f91c-a578-440e-91d3-d4db75f1419f tempest-VolumesGetTest-1307359977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:16:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-6f61f91c-a578-440e-91d3-d4db75f1419f tempest-VolumesGetTest-1307359977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:16:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-6f61f91c-a578-440e-91d3-d4db75f1419f tempest-VolumesGetTest-1307359977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6f61f91c-a578-440e-91d3-d4db75f1419f tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:50 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:16:50 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:51 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:51 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-517fb1b4-f847-4844-849a-272c288cdd96 tempest-VolumesGetTest-1307359977 None] Acquiring lock "cinder-28462972-c58f-464b-9e54-c10a4dc52242-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:16:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6f61f91c-a578-440e-91d3-d4db75f1419f tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.187s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:51 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-6f61f91c-a578-440e-91d3-d4db75f1419f tempest-VolumesGetTest-1307359977 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:16:51 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-6f61f91c-a578-440e-91d3-d4db75f1419f tempest-VolumesGetTest-1307359977 None] Deleted volume successfully. Jun 29 11:16:51 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-517fb1b4-f847-4844-849a-272c288cdd96 tempest-VolumesGetTest-1307359977 None] Lock "cinder-28462972-c58f-464b-9e54-c10a4dc52242-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:16:51 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-6f61f91c-a578-440e-91d3-d4db75f1419f tempest-VolumesGetTest-1307359977 None] Lock "cinder-b4de8ed3-80b2-463f-a747-bcad99dfdff1-delete_volume" released by "delete_volume" :: held 3.537s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:51 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-517fb1b4-f847-4844-849a-272c288cdd96 tempest-VolumesGetTest-1307359977 None] Acquiring lock "cinder-quobyte-28462972-c58f-464b-9e54-c10a4dc52242" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:16:51 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-517fb1b4-f847-4844-849a-272c288cdd96 tempest-VolumesGetTest-1307359977 None] Lock "cinder-quobyte-28462972-c58f-464b-9e54-c10a4dc52242" acquired by "delete_volume" :: waited 0.024s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:16:51 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c987bdd1-bac1-4c7f-b82c-dfbb874b7ae5]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:16:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-517fb1b4-f847-4844-849a-272c288cdd96 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-28462972-c58f-464b-9e54-c10a4dc52242 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:52 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-28462972-c58f-464b-9e54-c10a4dc52242 Jun 29 11:16:52 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:52 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-517fb1b4-f847-4844-849a-272c288cdd96 tempest-VolumesGetTest-1307359977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-28462972-c58f-464b-9e54-c10a4dc52242" returned: 0 in 0.896s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-517fb1b4-f847-4844-849a-272c288cdd96 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-28462972-c58f-464b-9e54-c10a4dc52242 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:52 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-28462972-c58f-464b-9e54-c10a4dc52242 Jun 29 11:16:52 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:53 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-517fb1b4-f847-4844-849a-272c288cdd96 tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-28462972-c58f-464b-9e54-c10a4dc52242" returned: 0 in 0.739s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:53 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-517fb1b4-f847-4844-849a-272c288cdd96 tempest-VolumesGetTest-1307359977 None] Lock "cinder-quobyte-28462972-c58f-464b-9e54-c10a4dc52242" released by "delete_volume" :: held 1.701s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:53 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-517fb1b4-f847-4844-849a-272c288cdd96 tempest-VolumesGetTest-1307359977 None] Created reservations ['fe370470-4d07-42b6-b1b2-d60e79e73a41', '61257586-bd5e-4d8d-8cfe-0027f55c8ca8', '6edd5cdd-702c-404e-b5f5-57579d38aedb', 'fa015070-5f0b-4dc8-9c94-c90d4ebe8f20'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:16:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-517fb1b4-f847-4844-849a-272c288cdd96 tempest-VolumesGetTest-1307359977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-517fb1b4-f847-4844-849a-272c288cdd96 tempest-VolumesGetTest-1307359977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-517fb1b4-f847-4844-849a-272c288cdd96 tempest-VolumesGetTest-1307359977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:16:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-517fb1b4-f847-4844-849a-272c288cdd96 tempest-VolumesGetTest-1307359977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:16:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-517fb1b4-f847-4844-849a-272c288cdd96 tempest-VolumesGetTest-1307359977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-517fb1b4-f847-4844-849a-272c288cdd96 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:53 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:16:53 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:54 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-517fb1b4-f847-4844-849a-272c288cdd96 tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.862s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:54 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-517fb1b4-f847-4844-849a-272c288cdd96 tempest-VolumesGetTest-1307359977 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:16:54 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-517fb1b4-f847-4844-849a-272c288cdd96 tempest-VolumesGetTest-1307359977 None] Deleted volume successfully. Jun 29 11:16:54 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-517fb1b4-f847-4844-849a-272c288cdd96 tempest-VolumesGetTest-1307359977 None] Lock "cinder-28462972-c58f-464b-9e54-c10a4dc52242-delete_volume" released by "delete_volume" :: held 2.843s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:16:54 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:16:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] Flow 'volume_create_manager' (a5bb8bc5-2b51-442e-a0b8-39bc7b04504c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:16:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d384085e-4561-440f-b7ed-f8373f11fae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d384085e-4561-440f-b7ed-f8373f11fae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1674931767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae786721-0dc4-4e3c-9096-db5aca7a2089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e86266cdf3432fa02a008cf313fac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:16:55Z,use_quota=True,user_id='77e05219ad094f72a78097d245f210a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ddac148-1ae6-4444-a600-87c16a462235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ddac148-1ae6-4444-a600-87c16a462235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (670ee462-4c15-41ad-8a20-134488dec838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (670ee462-4c15-41ad-8a20-134488dec838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae786721-0dc4-4e3c-9096-db5aca7a2089', 'volume_name': 'volume-ae786721-0dc4-4e3c-9096-db5aca7a2089', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f53fd2-85fc-472a-940b-5f9aaac264ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f53fd2-85fc-472a-940b-5f9aaac264ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7561e474-52d3-40ea-9e20-d2c5f04ec87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:54 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] Volume ae786721-0dc4-4e3c-9096-db5aca7a2089: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae786721-0dc4-4e3c-9096-db5aca7a2089', 'volume_size': 1} Jun 29 11:16:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1674931767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae786721-0dc4-4e3c-9096-db5aca7a2089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e86266cdf3432fa02a008cf313fac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:16:55Z,use_quota=True,user_id='77e05219ad094f72a78097d245f210a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:16:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] Creating volume ae786721-0dc4-4e3c-9096-db5aca7a2089 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:16:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:16:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:16:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:16:54 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:16:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:54 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089 1073741824 Jun 29 11:16:54 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:55 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089 1073741824" returned: 0 in 1.090s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:56 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089 Jun 29 11:16:56 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089" returned: 0 in 0.700s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:16:56 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:16:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7561e474-52d3-40ea-9e20-d2c5f04ec87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae786721-0dc4-4e3c-9096-db5aca7a2089', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd39f37-4029-4cf5-afb3-dc0b7a662029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:56 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] Volume volume-ae786721-0dc4-4e3c-9096-db5aca7a2089 (ae786721-0dc4-4e3c-9096-db5aca7a2089): created successfully Jun 29 11:16:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd39f37-4029-4cf5-afb3-dc0b7a662029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] Flow 'volume_create_manager' (a5bb8bc5-2b51-442e-a0b8-39bc7b04504c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:16:56 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-3346b862-c029-4977-bc8b-33e58ed2739d tempest-VolumesGetTest-1307359977 None] Created volume successfully. Jun 29 11:16:58 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:16:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Flow 'volume_create_manager' (831ab86e-e7f0-4d54-b2ae-2f4a3d3259b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:16:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18fc4b42-6ecd-46ab-8742-eeeb1126f886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18fc4b42-6ecd-46ab-8742-eeeb1126f886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-364095563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b4172e-17e0-4e53-bc48-508809b5306b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='61e86266cdf3432fa02a008cf313fac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=ae786721-0dc4-4e3c-9096-db5aca7a2089,status='creating',terminated_at=None,updated_at=2026-06-29T09:16:59Z,use_quota=True,user_id='77e05219ad094f72a78097d245f210a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc3d2af-0eb7-40e9-9ab2-44c810e3ce19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc3d2af-0eb7-40e9-9ab2-44c810e3ce19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f98f32-81cd-46e0-ab3f-d62bcc9a5b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f98f32-81cd-46e0-ab3f-d62bcc9a5b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f3b4172e-17e0-4e53-bc48-508809b5306b', 'volume_name': 'volume-f3b4172e-17e0-4e53-bc48-508809b5306b', 'volume_size': 1, 'source_volid': 'ae786721-0dc4-4e3c-9096-db5aca7a2089', 'source_volstatus': 'available'}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8623638-d9e5-4905-95fc-dd6d0a04f3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8623638-d9e5-4905-95fc-dd6d0a04f3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:16:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf7139d-6c58-47fc-bc2f-5b010d3e02fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:16:58 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Volume f3b4172e-17e0-4e53-bc48-508809b5306b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f3b4172e-17e0-4e53-bc48-508809b5306b', 'volume_size': 1, 'source_volid': 'ae786721-0dc4-4e3c-9096-db5aca7a2089', 'source_volstatus': 'available'} Jun 29 11:16:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:16:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:16:58 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Cloning volume ae786721-0dc4-4e3c-9096-db5aca7a2089 to volume f3b4172e-17e0-4e53-bc48-508809b5306b Jun 29 11:16:58 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Creating offline snapshot 1dc087ff-0cdd-4138-b405-9576d02ef9a3 of volume ae786721-0dc4-4e3c-9096-db5aca7a2089 {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:16:58 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0ae075-095c-4ceb-9f0c-2f27637eaf93]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:16:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:16:59 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089 Jun 29 11:16:59 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:16:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089" returned: 0 in 1.079s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:16:59 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Jun 29 11:16:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089.1dc087ff-0cdd-4138-b405-9576d02ef9a3 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:00 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089.1dc087ff-0cdd-4138-b405-9576d02ef9a3 1G Jun 29 11:17:00 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:01 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089.1dc087ff-0cdd-4138-b405-9576d02ef9a3 1G" returned: 0 in 1.298s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae786721-0dc4-4e3c-9096-db5aca7a2089 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089.1dc087ff-0cdd-4138-b405-9576d02ef9a3 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:01 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae786721-0dc4-4e3c-9096-db5aca7a2089 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089.1dc087ff-0cdd-4138-b405-9576d02ef9a3 Jun 29 11:17:01 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:02 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae786721-0dc4-4e3c-9096-db5aca7a2089 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089.1dc087ff-0cdd-4138-b405-9576d02ef9a3" returned: 0 in 0.936s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:02 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089.1dc087ff-0cdd-4138-b405-9576d02ef9a3 is being set with open permissions: ugo+rw Jun 29 11:17:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089.1dc087ff-0cdd-4138-b405-9576d02ef9a3 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:02 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089.1dc087ff-0cdd-4138-b405-9576d02ef9a3 Jun 29 11:17:02 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:02 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:17:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] Flow 'volume_create_manager' (983904bd-bc8f-4a41-b9fc-7ddb90a5d33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:17:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b492e557-5895-4870-a3ad-e80ced8162b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b492e557-5895-4870-a3ad-e80ced8162b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2044968230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8312f87-24bb-4955-9264-155fd1a4eb1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a89ffaf19cd64e6998bf7bf9d267c7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:17:02Z,use_quota=True,user_id='a444ead5c6804988acfa4567431e3be0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34737354-de39-4d6d-80e5-3e9cdcdb94d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34737354-de39-4d6d-80e5-3e9cdcdb94d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7ff0f2-67b1-4ccc-ac4a-d34b02bee612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7ff0f2-67b1-4ccc-ac4a-d34b02bee612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8312f87-24bb-4955-9264-155fd1a4eb1d', 'volume_name': 'volume-b8312f87-24bb-4955-9264-155fd1a4eb1d', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a15104a-111f-43e6-9084-64006d84fa26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a15104a-111f-43e6-9084-64006d84fa26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a3cb660-e5ec-46f3-8ccb-87304e9006e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:02 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] Volume b8312f87-24bb-4955-9264-155fd1a4eb1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8312f87-24bb-4955-9264-155fd1a4eb1d', 'volume_size': 1} Jun 29 11:17:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:03 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089.1dc087ff-0cdd-4138-b405-9576d02ef9a3" returned: 0 in 0.905s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:03 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089.info Jun 29 11:17:03 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:03 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089.info" returned: 0 in 0.805s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:03 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089.info is being set with open permissions: ugo+rw Jun 29 11:17:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:03 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089.info Jun 29 11:17:03 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:04 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089.info" returned: 0 in 0.671s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:04 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Acquiring lock "cinder-quobyte-f3b4172e-17e0-4e53-bc48-508809b5306b" by "_copy_volume_from_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:17:04 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Lock "cinder-quobyte-f3b4172e-17e0-4e53-bc48-508809b5306b" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:17:04 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] snapshot: 1dc087ff-0cdd-4138-b405-9576d02ef9a3, volume: f3b4172e-17e0-4e53-bc48-508809b5306b, {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 11:17:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:04 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:17:04 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:17:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:04 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3bbbb3-1348-41c5-8c06-2b17e1e062bf]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:17:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089.1dc087ff-0cdd-4138-b405-9576d02ef9a3 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:04 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089.1dc087ff-0cdd-4138-b405-9576d02ef9a3 Jun 29 11:17:04 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:05 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089.1dc087ff-0cdd-4138-b405-9576d02ef9a3" returned: 0 in 0.903s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:05 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae786721-0dc4-4e3c-9096-db5aca7a2089(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:17:05 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089 {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 11:17:05 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Creating direct copy from snapshot {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 11:17:05 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b1322f-9242-4826-b8ff-de75397be868]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:17:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:05 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089 Jun 29 11:17:05 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:06 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089" returned: 0 in 1.102s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:06 devstack cinder-volume[93497]: DEBUG cinder.utils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Path /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f3b4172e-17e0-4e53-bc48-508809b5306b not found in is_blk_device check {{(pid=93497) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 11:17:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f3b4172e-17e0-4e53-bc48-508809b5306b {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:06 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f3b4172e-17e0-4e53-bc48-508809b5306b Jun 29 11:17:06 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:08 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:17:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:17:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:17:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:08 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:17:08 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:09 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.767s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:09 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:17:09 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager._thread_info {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:17:09 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread count: 29 {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 11:17:09 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread info: [<_MainThread(MainThread, started 131117520400512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 11:17:12 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f3b4172e-17e0-4e53-bc48-508809b5306b" returned: 0 in 6.184s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:12 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5abd3f-6b85-4c33-a5b7-ad761680835b]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:17:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:13 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089 Jun 29 11:17:13 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:13 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:UPDATE=60,cinder:SELECT=42,cinder:INSERT=19,cinder:DELETE=6 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:17:13 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:UPDATE=92,cinder:SELECT=59,cinder:INSERT=20,cinder:DELETE=7 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:17:13 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:17:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] Flow 'volume_create_manager' (0608de8f-1728-4188-89c9-2ce115b63d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:17:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c67bbee-8ce2-4074-86a5-748dc9afa057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c67bbee-8ce2-4074-86a5-748dc9afa057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-757465399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=757ba905-0bf5-4c92-a710-366d60f749a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4a7567c6aba4aaebe1eb68d41a625ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:17:14Z,use_quota=True,user_id='04e24e1fea6e4c40b43b62dda85e9862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e66346-9fe7-4024-a262-c0bfd62aa661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e66346-9fe7-4024-a262-c0bfd62aa661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b36fdda-4733-4c99-9e26-75525631192f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b36fdda-4733-4c99-9e26-75525631192f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '757ba905-0bf5-4c92-a710-366d60f749a0', 'volume_name': 'volume-757ba905-0bf5-4c92-a710-366d60f749a0', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b387dce1-c259-42fa-98a1-93b86b77c85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b387dce1-c259-42fa-98a1-93b86b77c85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a12c40e-72cf-4674-bd69-e00e9a539a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:13 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] Volume 757ba905-0bf5-4c92-a710-366d60f749a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-757ba905-0bf5-4c92-a710-366d60f749a0', 'volume_size': 1} Jun 29 11:17:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:14 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089" returned: 0 in 1.086s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:14 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Image conversion details: src /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089, size 1024.00 MB, duration 6.19 sec, destination /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f3b4172e-17e0-4e53-bc48-508809b5306b {{(pid=93497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 11:17:14 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Converted 1024.00 MB image at 165.55 MB/s Jun 29 11:17:14 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f3b4172e-17e0-4e53-bc48-508809b5306b is being set with open permissions: ugo+rw Jun 29 11:17:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f3b4172e-17e0-4e53-bc48-508809b5306b {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:14 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f3b4172e-17e0-4e53-bc48-508809b5306b Jun 29 11:17:14 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:14 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f3b4172e-17e0-4e53-bc48-508809b5306b" returned: 0 in 0.679s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:14 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Lock "cinder-quobyte-f3b4172e-17e0-4e53-bc48-508809b5306b" released by "_copy_volume_from_snapshot" :: held 10.056s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:17:14 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Acquiring lock "cinder-quobyte-1dc087ff-0cdd-4138-b405-9576d02ef9a3" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:17:14 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Lock "cinder-quobyte-1dc087ff-0cdd-4138-b405-9576d02ef9a3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:17:14 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Deleting offline snapshot 1dc087ff-0cdd-4138-b405-9576d02ef9a3 of volume ae786721-0dc4-4e3c-9096-db5aca7a2089 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:17:14 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] snapshot_file for this snap is: volume-ae786721-0dc4-4e3c-9096-db5aca7a2089.1dc087ff-0cdd-4138-b405-9576d02ef9a3 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:17:14 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc086a98-7baf-4865-a14a-454cd08f80b3]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:17:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089.1dc087ff-0cdd-4138-b405-9576d02ef9a3 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:14 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089.1dc087ff-0cdd-4138-b405-9576d02ef9a3 Jun 29 11:17:14 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:15 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089.1dc087ff-0cdd-4138-b405-9576d02ef9a3" returned: 0 in 0.762s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:15 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae786721-0dc4-4e3c-9096-db5aca7a2089(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:17:15 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c56a53b-3dd8-462e-8adc-97bc09922aa3]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:17:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:15 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089 Jun 29 11:17:15 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:16 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089" returned: 0 in 0.723s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089.1dc087ff-0cdd-4138-b405-9576d02ef9a3 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:16 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089.1dc087ff-0cdd-4138-b405-9576d02ef9a3 Jun 29 11:17:16 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:17 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089.1dc087ff-0cdd-4138-b405-9576d02ef9a3" returned: 0 in 0.773s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089.1dc087ff-0cdd-4138-b405-9576d02ef9a3 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:17 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089.1dc087ff-0cdd-4138-b405-9576d02ef9a3 Jun 29 11:17:17 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:17 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089.1dc087ff-0cdd-4138-b405-9576d02ef9a3" returned: 0 in 0.630s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:17 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Lock "cinder-quobyte-1dc087ff-0cdd-4138-b405-9576d02ef9a3" released by "_delete_snapshot" :: held 2.978s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:17:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.988s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.244s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2044968230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8312f87-24bb-4955-9264-155fd1a4eb1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a89ffaf19cd64e6998bf7bf9d267c7f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:17:02Z,use_quota=True,user_id='a444ead5c6804988acfa4567431e3be0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:17:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] Creating volume b8312f87-24bb-4955-9264-155fd1a4eb1d {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:17:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:17:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:17:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:17:17 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:17:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:17 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d 1073741824 Jun 29 11:17:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf7139d-6c58-47fc-bc2f-5b010d3e02fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3b4172e-17e0-4e53-bc48-508809b5306b', 'volume_size': 1, 'source_volid': 'ae786721-0dc4-4e3c-9096-db5aca7a2089', 'source_volstatus': 'available'}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:17 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b23d65c-98ea-4035-a8ca-832c031ed9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:17 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Volume volume-f3b4172e-17e0-4e53-bc48-508809b5306b (f3b4172e-17e0-4e53-bc48-508809b5306b): created successfully Jun 29 11:17:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b23d65c-98ea-4035-a8ca-832c031ed9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Flow 'volume_create_manager' (831ab86e-e7f0-4d54-b2ae-2f4a3d3259b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:17:17 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-c94bac43-5423-4d0c-8b7a-466a04f57bef tempest-VolumesGetTest-1307359977 None] Created volume successfully. Jun 29 11:17:18 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d 1073741824" returned: 0 in 0.940s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:18 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d Jun 29 11:17:18 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:19 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:17:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] Flow 'volume_create_manager' (311f1fae-08b7-48fe-a95a-5e06a9f7e7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:17:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (402ecdfb-b378-4995-87f0-61e7317c7047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (402ecdfb-b378-4995-87f0-61e7317c7047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:17:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-843131839',display_name='tempest-VolumesGetTest-Volume-1042280196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=318f3666-88b3-4488-b6e5-e1e78a2757ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e86266cdf3432fa02a008cf313fac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:17:19Z,use_quota=True,user_id='77e05219ad094f72a78097d245f210a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f184541-34c2-41e3-bcce-62a7aec4a9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f184541-34c2-41e3-bcce-62a7aec4a9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f4f037-f521-46e0-b226-8a60192934fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f4f037-f521-46e0-b226-8a60192934fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '318f3666-88b3-4488-b6e5-e1e78a2757ee', 'volume_name': 'volume-318f3666-88b3-4488-b6e5-e1e78a2757ee', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfe0f06-ad11-441a-960a-e92daaa4801f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfe0f06-ad11-441a-960a-e92daaa4801f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbb499a6-3f44-4a6a-962a-1ab9414c6773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:19 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] Volume 318f3666-88b3-4488-b6e5-e1e78a2757ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-318f3666-88b3-4488-b6e5-e1e78a2757ee', 'volume_size': 1} Jun 29 11:17:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:19 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d" returned: 0 in 0.886s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:19 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:17:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.684s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:19 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-757465399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=757ba905-0bf5-4c92-a710-366d60f749a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4a7567c6aba4aaebe1eb68d41a625ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:17:14Z,use_quota=True,user_id='04e24e1fea6e4c40b43b62dda85e9862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:17:19 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] Creating volume 757ba905-0bf5-4c92-a710-366d60f749a0 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:17:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:19 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:17:19 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:17:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:19 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:17:19 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:17:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-757ba905-0bf5-4c92-a710-366d60f749a0 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a3cb660-e5ec-46f3-8ccb-87304e9006e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8312f87-24bb-4955-9264-155fd1a4eb1d', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8be43219-48ed-4cc3-896c-34fa8bad4e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:19 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-757ba905-0bf5-4c92-a710-366d60f749a0 1073741824 Jun 29 11:17:19 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:19 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] Volume volume-b8312f87-24bb-4955-9264-155fd1a4eb1d (b8312f87-24bb-4955-9264-155fd1a4eb1d): created successfully Jun 29 11:17:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8be43219-48ed-4cc3-896c-34fa8bad4e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] Flow 'volume_create_manager' (983904bd-bc8f-4a41-b9fc-7ddb90a5d33f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:17:19 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-4a8da6e1-973d-489f-8bbd-02a6b0c483b1 req-4856b5c6-d709-4a72-bf9b-37bfb9f3b6c9 tempest-VolumesSnapshotsTestJSON-772230405 None] Created volume successfully. Jun 29 11:17:20 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-757ba905-0bf5-4c92-a710-366d60f749a0 1073741824" returned: 0 in 1.203s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-40216d41-32a7-4dab-8367-eec4b9e49470 req-41e840df-8453-49a9-b0dd-3988a5bbdbeb tempest-VolumesSnapshotsTestJSON-772230405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-757ba905-0bf5-4c92-a710-366d60f749a0 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:20 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-757ba905-0bf5-4c92-a710-366d60f749a0 Jun 29 11:17:20 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:21 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-757ba905-0bf5-4c92-a710-366d60f749a0" returned: 0 in 0.841s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:21 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] <== create_volume: return (2141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:17:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.146s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.287s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:21 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:17:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-843131839',display_name='tempest-VolumesGetTest-Volume-1042280196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=318f3666-88b3-4488-b6e5-e1e78a2757ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e86266cdf3432fa02a008cf313fac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:17:19Z,use_quota=True,user_id='77e05219ad094f72a78097d245f210a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:17:21 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] Creating volume 318f3666-88b3-4488-b6e5-e1e78a2757ee {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:17:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:21 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:17:21 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:17:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:21 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:17:21 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:17:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-318f3666-88b3-4488-b6e5-e1e78a2757ee 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:21 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-318f3666-88b3-4488-b6e5-e1e78a2757ee 1073741824 Jun 29 11:17:21 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:21 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a12c40e-72cf-4674-bd69-e00e9a539a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-757ba905-0bf5-4c92-a710-366d60f749a0', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:21 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30119f9c-9118-4c9f-a0e1-0f42abde9f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:21 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] Volume volume-757ba905-0bf5-4c92-a710-366d60f749a0 (757ba905-0bf5-4c92-a710-366d60f749a0): created successfully Jun 29 11:17:21 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30119f9c-9118-4c9f-a0e1-0f42abde9f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:21 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] Flow 'volume_create_manager' (0608de8f-1728-4188-89c9-2ce115b63d6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:17:21 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-abc84f79-6826-47bf-860a-2a8b89d7907b tempest-VolumesTransfersV355Test-197389201 None] Created volume successfully. Jun 29 11:17:22 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-318f3666-88b3-4488-b6e5-e1e78a2757ee 1073741824" returned: 0 in 0.963s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-318f3666-88b3-4488-b6e5-e1e78a2757ee {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:22 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-318f3666-88b3-4488-b6e5-e1e78a2757ee Jun 29 11:17:22 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:23 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-9ab41055-69ed-47ed-8084-0cef65927497 tempest-VolumesTransfersV355Test-1575219631 None] Transfer volume completed successfully. Jun 29 11:17:23 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-318f3666-88b3-4488-b6e5-e1e78a2757ee" returned: 0 in 0.642s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:23 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:17:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-40216d41-32a7-4dab-8367-eec4b9e49470 req-41e840df-8453-49a9-b0dd-3988a5bbdbeb tempest-VolumesSnapshotsTestJSON-772230405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.543s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbb499a6-3f44-4a6a-962a-1ab9414c6773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-318f3666-88b3-4488-b6e5-e1e78a2757ee', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c4928c-8c39-400c-8820-fa6fb0ce124f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:23 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [req-40216d41-32a7-4dab-8367-eec4b9e49470 req-41e840df-8453-49a9-b0dd-3988a5bbdbeb tempest-VolumesSnapshotsTestJSON-772230405 None] Creating offline snapshot 4a476222-9581-4a3f-91de-014f5d5841a6 of volume b8312f87-24bb-4955-9264-155fd1a4eb1d {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:17:23 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] Volume volume-318f3666-88b3-4488-b6e5-e1e78a2757ee (318f3666-88b3-4488-b6e5-e1e78a2757ee): created successfully Jun 29 11:17:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c4928c-8c39-400c-8820-fa6fb0ce124f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] Flow 'volume_create_manager' (311f1fae-08b7-48fe-a95a-5e06a9f7e7f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:17:23 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[965e666e-9b19-4613-aaaf-cad81524ca51]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:17:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-40216d41-32a7-4dab-8367-eec4b9e49470 req-41e840df-8453-49a9-b0dd-3988a5bbdbeb tempest-VolumesSnapshotsTestJSON-772230405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:23 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-5e8b2873-f48a-4835-bfe1-0a14cfa6176d tempest-VolumesGetTest-1307359977 None] Created volume successfully. Jun 29 11:17:23 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d Jun 29 11:17:23 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:24 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1f044476-a594-45e5-b25e-41b9a24859d3 tempest-VolumesTransfersV355Test-117249035 None] Acquiring lock "cinder-757ba905-0bf5-4c92-a710-366d60f749a0-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:17:24 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1f044476-a594-45e5-b25e-41b9a24859d3 tempest-VolumesTransfersV355Test-117249035 None] Lock "cinder-757ba905-0bf5-4c92-a710-366d60f749a0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:17:24 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1f044476-a594-45e5-b25e-41b9a24859d3 tempest-VolumesTransfersV355Test-117249035 None] Acquiring lock "cinder-quobyte-757ba905-0bf5-4c92-a710-366d60f749a0" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:17:24 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1f044476-a594-45e5-b25e-41b9a24859d3 tempest-VolumesTransfersV355Test-117249035 None] Lock "cinder-quobyte-757ba905-0bf5-4c92-a710-366d60f749a0" acquired by "delete_volume" :: waited 0.020s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:17:24 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e26d288-d997-4a98-9184-9b67d2c1b7dd]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:17:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1f044476-a594-45e5-b25e-41b9a24859d3 tempest-VolumesTransfersV355Test-117249035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-757ba905-0bf5-4c92-a710-366d60f749a0 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:24 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-40216d41-32a7-4dab-8367-eec4b9e49470 req-41e840df-8453-49a9-b0dd-3988a5bbdbeb tempest-VolumesSnapshotsTestJSON-772230405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d" returned: 0 in 0.860s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-40216d41-32a7-4dab-8367-eec4b9e49470 req-41e840df-8453-49a9-b0dd-3988a5bbdbeb tempest-VolumesSnapshotsTestJSON-772230405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d.4a476222-9581-4a3f-91de-014f5d5841a6 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:24 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d.4a476222-9581-4a3f-91de-014f5d5841a6 1G Jun 29 11:17:24 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:24 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-757ba905-0bf5-4c92-a710-366d60f749a0 Jun 29 11:17:24 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:24 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1faff81f-5bf0-4d12-bf8e-21b6ec04704e tempest-VolumesGetTest-1307359977 None] Acquiring lock "cinder-318f3666-88b3-4488-b6e5-e1e78a2757ee-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:17:24 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1faff81f-5bf0-4d12-bf8e-21b6ec04704e tempest-VolumesGetTest-1307359977 None] Lock "cinder-318f3666-88b3-4488-b6e5-e1e78a2757ee-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:17:24 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1faff81f-5bf0-4d12-bf8e-21b6ec04704e tempest-VolumesGetTest-1307359977 None] Acquiring lock "cinder-quobyte-318f3666-88b3-4488-b6e5-e1e78a2757ee" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:17:24 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1faff81f-5bf0-4d12-bf8e-21b6ec04704e tempest-VolumesGetTest-1307359977 None] Lock "cinder-quobyte-318f3666-88b3-4488-b6e5-e1e78a2757ee" acquired by "delete_volume" :: waited 0.022s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:17:24 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2e5a7c-3a57-4d5d-af2a-07b8b2daf77e]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:17:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1faff81f-5bf0-4d12-bf8e-21b6ec04704e tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-318f3666-88b3-4488-b6e5-e1e78a2757ee {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:25 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-318f3666-88b3-4488-b6e5-e1e78a2757ee Jun 29 11:17:25 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:25 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1f044476-a594-45e5-b25e-41b9a24859d3 tempest-VolumesTransfersV355Test-117249035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-757ba905-0bf5-4c92-a710-366d60f749a0" returned: 0 in 0.867s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1f044476-a594-45e5-b25e-41b9a24859d3 tempest-VolumesTransfersV355Test-117249035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-757ba905-0bf5-4c92-a710-366d60f749a0 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:25 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-757ba905-0bf5-4c92-a710-366d60f749a0 Jun 29 11:17:25 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:25 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-40216d41-32a7-4dab-8367-eec4b9e49470 req-41e840df-8453-49a9-b0dd-3988a5bbdbeb tempest-VolumesSnapshotsTestJSON-772230405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d.4a476222-9581-4a3f-91de-014f5d5841a6 1G" returned: 0 in 1.043s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-40216d41-32a7-4dab-8367-eec4b9e49470 req-41e840df-8453-49a9-b0dd-3988a5bbdbeb tempest-VolumesSnapshotsTestJSON-772230405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8312f87-24bb-4955-9264-155fd1a4eb1d -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d.4a476222-9581-4a3f-91de-014f5d5841a6 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:25 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8312f87-24bb-4955-9264-155fd1a4eb1d -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d.4a476222-9581-4a3f-91de-014f5d5841a6 Jun 29 11:17:25 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:25 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1faff81f-5bf0-4d12-bf8e-21b6ec04704e tempest-VolumesGetTest-1307359977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-318f3666-88b3-4488-b6e5-e1e78a2757ee" returned: 0 in 0.864s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1faff81f-5bf0-4d12-bf8e-21b6ec04704e tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-318f3666-88b3-4488-b6e5-e1e78a2757ee {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:25 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-318f3666-88b3-4488-b6e5-e1e78a2757ee Jun 29 11:17:25 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:25 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1f044476-a594-45e5-b25e-41b9a24859d3 tempest-VolumesTransfersV355Test-117249035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-757ba905-0bf5-4c92-a710-366d60f749a0" returned: 0 in 0.742s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:25 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1f044476-a594-45e5-b25e-41b9a24859d3 tempest-VolumesTransfersV355Test-117249035 None] Lock "cinder-quobyte-757ba905-0bf5-4c92-a710-366d60f749a0" released by "delete_volume" :: held 1.660s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:17:26 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-1f044476-a594-45e5-b25e-41b9a24859d3 tempest-VolumesTransfersV355Test-117249035 None] Created reservations ['f321ce7e-5e2a-44a5-8be7-ed7ef9b7ea31', '412f701a-154f-4175-a880-330a343438ff', 'fc41465b-aed7-413a-9976-03f9d43e0c21', '0f6cfcf8-7eca-4549-97ce-edb781f45afb'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:17:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1f044476-a594-45e5-b25e-41b9a24859d3 tempest-VolumesTransfersV355Test-117249035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1f044476-a594-45e5-b25e-41b9a24859d3 tempest-VolumesTransfersV355Test-117249035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:26 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1f044476-a594-45e5-b25e-41b9a24859d3 tempest-VolumesTransfersV355Test-117249035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:17:26 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1f044476-a594-45e5-b25e-41b9a24859d3 tempest-VolumesTransfersV355Test-117249035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:17:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1f044476-a594-45e5-b25e-41b9a24859d3 tempest-VolumesTransfersV355Test-117249035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1f044476-a594-45e5-b25e-41b9a24859d3 tempest-VolumesTransfersV355Test-117249035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:26 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:17:26 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:26 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-40216d41-32a7-4dab-8367-eec4b9e49470 req-41e840df-8453-49a9-b0dd-3988a5bbdbeb tempest-VolumesSnapshotsTestJSON-772230405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8312f87-24bb-4955-9264-155fd1a4eb1d -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d.4a476222-9581-4a3f-91de-014f5d5841a6" returned: 0 in 0.800s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:26 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [req-40216d41-32a7-4dab-8367-eec4b9e49470 req-41e840df-8453-49a9-b0dd-3988a5bbdbeb tempest-VolumesSnapshotsTestJSON-772230405 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d.4a476222-9581-4a3f-91de-014f5d5841a6 is being set with open permissions: ugo+rw Jun 29 11:17:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-40216d41-32a7-4dab-8367-eec4b9e49470 req-41e840df-8453-49a9-b0dd-3988a5bbdbeb tempest-VolumesSnapshotsTestJSON-772230405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d.4a476222-9581-4a3f-91de-014f5d5841a6 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:26 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d.4a476222-9581-4a3f-91de-014f5d5841a6 Jun 29 11:17:26 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:26 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1faff81f-5bf0-4d12-bf8e-21b6ec04704e tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-318f3666-88b3-4488-b6e5-e1e78a2757ee" returned: 0 in 0.789s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:26 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1faff81f-5bf0-4d12-bf8e-21b6ec04704e tempest-VolumesGetTest-1307359977 None] Lock "cinder-quobyte-318f3666-88b3-4488-b6e5-e1e78a2757ee" released by "delete_volume" :: held 1.740s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:17:26 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-1faff81f-5bf0-4d12-bf8e-21b6ec04704e tempest-VolumesGetTest-1307359977 None] Created reservations ['1b53d18d-c8a4-4b21-a98b-ed041fb1330b', 'd6340157-4d4e-4dca-958d-cf7a56721a1a', 'f79de210-d4fb-48b5-a43a-feea59ed9336', '401177e4-6e23-4342-b38c-c805a5d6812f'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:17:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1faff81f-5bf0-4d12-bf8e-21b6ec04704e tempest-VolumesGetTest-1307359977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1faff81f-5bf0-4d12-bf8e-21b6ec04704e tempest-VolumesGetTest-1307359977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:26 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1faff81f-5bf0-4d12-bf8e-21b6ec04704e tempest-VolumesGetTest-1307359977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:17:26 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1faff81f-5bf0-4d12-bf8e-21b6ec04704e tempest-VolumesGetTest-1307359977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:17:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1faff81f-5bf0-4d12-bf8e-21b6ec04704e tempest-VolumesGetTest-1307359977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1faff81f-5bf0-4d12-bf8e-21b6ec04704e tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:26 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:17:26 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:26 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1f044476-a594-45e5-b25e-41b9a24859d3 tempest-VolumesTransfersV355Test-117249035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.888s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:26 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-1f044476-a594-45e5-b25e-41b9a24859d3 tempest-VolumesTransfersV355Test-117249035 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:17:27 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-1f044476-a594-45e5-b25e-41b9a24859d3 tempest-VolumesTransfersV355Test-117249035 None] Deleted volume successfully. Jun 29 11:17:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1f044476-a594-45e5-b25e-41b9a24859d3 tempest-VolumesTransfersV355Test-117249035 None] Lock "cinder-757ba905-0bf5-4c92-a710-366d60f749a0-delete_volume" released by "delete_volume" :: held 2.830s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:17:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-49d367f8-dc80-456a-b63c-8bb667981734 tempest-VolumesGetTest-1307359977 None] Acquiring lock "cinder-f3b4172e-17e0-4e53-bc48-508809b5306b-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:17:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-49d367f8-dc80-456a-b63c-8bb667981734 tempest-VolumesGetTest-1307359977 None] Lock "cinder-f3b4172e-17e0-4e53-bc48-508809b5306b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:17:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-49d367f8-dc80-456a-b63c-8bb667981734 tempest-VolumesGetTest-1307359977 None] Acquiring lock "cinder-quobyte-f3b4172e-17e0-4e53-bc48-508809b5306b" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:17:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-49d367f8-dc80-456a-b63c-8bb667981734 tempest-VolumesGetTest-1307359977 None] Lock "cinder-quobyte-f3b4172e-17e0-4e53-bc48-508809b5306b" acquired by "delete_volume" :: waited 0.024s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:17:27 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:27 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26aea3d-9130-468f-ae39-0f0e7f9c90f4]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:17:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-49d367f8-dc80-456a-b63c-8bb667981734 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f3b4172e-17e0-4e53-bc48-508809b5306b {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-40216d41-32a7-4dab-8367-eec4b9e49470 req-41e840df-8453-49a9-b0dd-3988a5bbdbeb tempest-VolumesSnapshotsTestJSON-772230405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d.4a476222-9581-4a3f-91de-014f5d5841a6" returned: 0 in 1.165s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:27 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:17:27 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] Flow 'volume_create_manager' (ee3abc99-d7a1-405a-96bc-785080a98a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:17:27 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2a4e89-8299-4198-970f-1eb233739ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:27 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2a4e89-8299-4198-970f-1eb233739ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-364297655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad1701c-b0a9-4383-868c-101203e6a4aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4a7567c6aba4aaebe1eb68d41a625ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:17:27Z,use_quota=True,user_id='04e24e1fea6e4c40b43b62dda85e9862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:27 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76efccb4-e829-4166-ada5-adb99d680de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:27 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76efccb4-e829-4166-ada5-adb99d680de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:27 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624f18e3-0e13-40a4-838b-b5746d95bec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:27 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (624f18e3-0e13-40a4-838b-b5746d95bec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dad1701c-b0a9-4383-868c-101203e6a4aa', 'volume_name': 'volume-dad1701c-b0a9-4383-868c-101203e6a4aa', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:27 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad82c867-c060-461e-b2ac-c8349c7f2ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:27 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad82c867-c060-461e-b2ac-c8349c7f2ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:27 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d97fe13-875c-4f3a-8aed-0e93e19d9a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:27 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] Volume dad1701c-b0a9-4383-868c-101203e6a4aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dad1701c-b0a9-4383-868c-101203e6a4aa', 'volume_size': 1} Jun 29 11:17:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-40216d41-32a7-4dab-8367-eec4b9e49470 req-41e840df-8453-49a9-b0dd-3988a5bbdbeb tempest-VolumesSnapshotsTestJSON-772230405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:27 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d.info Jun 29 11:17:27 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:27 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f3b4172e-17e0-4e53-bc48-508809b5306b Jun 29 11:17:27 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:28 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1faff81f-5bf0-4d12-bf8e-21b6ec04704e tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.164s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:28 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-1faff81f-5bf0-4d12-bf8e-21b6ec04704e tempest-VolumesGetTest-1307359977 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:17:28 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-1faff81f-5bf0-4d12-bf8e-21b6ec04704e tempest-VolumesGetTest-1307359977 None] Deleted volume successfully. Jun 29 11:17:28 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1faff81f-5bf0-4d12-bf8e-21b6ec04704e tempest-VolumesGetTest-1307359977 None] Lock "cinder-318f3666-88b3-4488-b6e5-e1e78a2757ee-delete_volume" released by "delete_volume" :: held 3.280s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:17:28 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-40216d41-32a7-4dab-8367-eec4b9e49470 req-41e840df-8453-49a9-b0dd-3988a5bbdbeb tempest-VolumesSnapshotsTestJSON-772230405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d.info" returned: 0 in 1.199s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:28 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [req-40216d41-32a7-4dab-8367-eec4b9e49470 req-41e840df-8453-49a9-b0dd-3988a5bbdbeb tempest-VolumesSnapshotsTestJSON-772230405 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d.info is being set with open permissions: ugo+rw Jun 29 11:17:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-40216d41-32a7-4dab-8367-eec4b9e49470 req-41e840df-8453-49a9-b0dd-3988a5bbdbeb tempest-VolumesSnapshotsTestJSON-772230405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:28 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d.info Jun 29 11:17:28 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:28 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-49d367f8-dc80-456a-b63c-8bb667981734 tempest-VolumesGetTest-1307359977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f3b4172e-17e0-4e53-bc48-508809b5306b" returned: 0 in 1.632s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-49d367f8-dc80-456a-b63c-8bb667981734 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f3b4172e-17e0-4e53-bc48-508809b5306b {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:29 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f3b4172e-17e0-4e53-bc48-508809b5306b Jun 29 11:17:29 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:29 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-40216d41-32a7-4dab-8367-eec4b9e49470 req-41e840df-8453-49a9-b0dd-3988a5bbdbeb tempest-VolumesSnapshotsTestJSON-772230405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d.info" returned: 0 in 0.848s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-40216d41-32a7-4dab-8367-eec4b9e49470 req-41e840df-8453-49a9-b0dd-3988a5bbdbeb tempest-VolumesSnapshotsTestJSON-772230405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.211s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.105s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:29 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-364297655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad1701c-b0a9-4383-868c-101203e6a4aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4a7567c6aba4aaebe1eb68d41a625ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:17:27Z,use_quota=True,user_id='04e24e1fea6e4c40b43b62dda85e9862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:17:29 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] Creating volume dad1701c-b0a9-4383-868c-101203e6a4aa {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:17:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:29 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:17:29 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:17:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:29 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:17:29 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:17:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-dad1701c-b0a9-4383-868c-101203e6a4aa 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:29 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-dad1701c-b0a9-4383-868c-101203e6a4aa 1073741824 Jun 29 11:17:29 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:29 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-40216d41-32a7-4dab-8367-eec4b9e49470 req-41e840df-8453-49a9-b0dd-3988a5bbdbeb tempest-VolumesSnapshotsTestJSON-772230405 None] Create snapshot completed successfully Jun 29 11:17:29 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-49d367f8-dc80-456a-b63c-8bb667981734 tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f3b4172e-17e0-4e53-bc48-508809b5306b" returned: 0 in 0.817s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:29 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-49d367f8-dc80-456a-b63c-8bb667981734 tempest-VolumesGetTest-1307359977 None] Lock "cinder-quobyte-f3b4172e-17e0-4e53-bc48-508809b5306b" released by "delete_volume" :: held 2.521s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:17:29 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-49d367f8-dc80-456a-b63c-8bb667981734 tempest-VolumesGetTest-1307359977 None] Created reservations ['616a3c66-cce9-4a82-afa9-5ae650ef1277', 'afb0f3e5-8810-4d45-9801-24440ee0ba38', '29f46de0-5bb3-43b5-8fae-4a9a393130d4', 'e8a71b17-622e-41b6-b70f-9cdc6e34baa7'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:17:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-49d367f8-dc80-456a-b63c-8bb667981734 tempest-VolumesGetTest-1307359977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-49d367f8-dc80-456a-b63c-8bb667981734 tempest-VolumesGetTest-1307359977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:29 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-49d367f8-dc80-456a-b63c-8bb667981734 tempest-VolumesGetTest-1307359977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:17:29 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-49d367f8-dc80-456a-b63c-8bb667981734 tempest-VolumesGetTest-1307359977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:17:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-49d367f8-dc80-456a-b63c-8bb667981734 tempest-VolumesGetTest-1307359977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-49d367f8-dc80-456a-b63c-8bb667981734 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:30 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:17:30 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:30 devstack cinder-volume[93497]: DEBUG cinder.coordination [req-7023bb9c-51bc-4d2f-ba5c-66d975ee3cd3 req-e4b3fe81-c73f-4ad3-aa40-6624eb80f3b2 tempest-VolumesSnapshotsTestJSON-772230405 None] Acquiring lock "cinder-4a476222-9581-4a3f-91de-014f5d5841a6-delete_snapshot" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:17:30 devstack cinder-volume[93497]: DEBUG cinder.coordination [req-7023bb9c-51bc-4d2f-ba5c-66d975ee3cd3 req-e4b3fe81-c73f-4ad3-aa40-6624eb80f3b2 tempest-VolumesSnapshotsTestJSON-772230405 None] Lock "cinder-4a476222-9581-4a3f-91de-014f5d5841a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:17:30 devstack cinder-volume[93497]: DEBUG cinder.coordination [req-7023bb9c-51bc-4d2f-ba5c-66d975ee3cd3 req-e4b3fe81-c73f-4ad3-aa40-6624eb80f3b2 tempest-VolumesSnapshotsTestJSON-772230405 None] Acquiring lock "cinder-quobyte-b8312f87-24bb-4955-9264-155fd1a4eb1d" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:17:30 devstack cinder-volume[93497]: DEBUG cinder.coordination [req-7023bb9c-51bc-4d2f-ba5c-66d975ee3cd3 req-e4b3fe81-c73f-4ad3-aa40-6624eb80f3b2 tempest-VolumesSnapshotsTestJSON-772230405 None] Lock "cinder-quobyte-b8312f87-24bb-4955-9264-155fd1a4eb1d" acquired by "delete_snapshot" :: waited 0.057s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:17:30 devstack cinder-volume[93497]: DEBUG cinder.coordination [req-7023bb9c-51bc-4d2f-ba5c-66d975ee3cd3 req-e4b3fe81-c73f-4ad3-aa40-6624eb80f3b2 tempest-VolumesSnapshotsTestJSON-772230405 None] Acquiring lock "cinder-quobyte-4a476222-9581-4a3f-91de-014f5d5841a6" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:17:30 devstack cinder-volume[93497]: DEBUG cinder.coordination [req-7023bb9c-51bc-4d2f-ba5c-66d975ee3cd3 req-e4b3fe81-c73f-4ad3-aa40-6624eb80f3b2 tempest-VolumesSnapshotsTestJSON-772230405 None] Lock "cinder-quobyte-4a476222-9581-4a3f-91de-014f5d5841a6" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:17:30 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [req-7023bb9c-51bc-4d2f-ba5c-66d975ee3cd3 req-e4b3fe81-c73f-4ad3-aa40-6624eb80f3b2 tempest-VolumesSnapshotsTestJSON-772230405 None] Deleting offline snapshot 4a476222-9581-4a3f-91de-014f5d5841a6 of volume b8312f87-24bb-4955-9264-155fd1a4eb1d {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:17:30 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [req-7023bb9c-51bc-4d2f-ba5c-66d975ee3cd3 req-e4b3fe81-c73f-4ad3-aa40-6624eb80f3b2 tempest-VolumesSnapshotsTestJSON-772230405 None] snapshot_file for this snap is: volume-b8312f87-24bb-4955-9264-155fd1a4eb1d.4a476222-9581-4a3f-91de-014f5d5841a6 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:17:30 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1568bf-8f7f-4153-8add-bef2acb4dbcf]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:17:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-7023bb9c-51bc-4d2f-ba5c-66d975ee3cd3 req-e4b3fe81-c73f-4ad3-aa40-6624eb80f3b2 tempest-VolumesSnapshotsTestJSON-772230405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d.4a476222-9581-4a3f-91de-014f5d5841a6 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:30 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d.4a476222-9581-4a3f-91de-014f5d5841a6 Jun 29 11:17:30 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:30 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-dbbeea27-2455-43ee-aff4-845f995cf428 tempest-VolumesGetTest-1307359977 None] Acquiring lock "cinder-ae786721-0dc4-4e3c-9096-db5aca7a2089-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:17:30 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-dbbeea27-2455-43ee-aff4-845f995cf428 tempest-VolumesGetTest-1307359977 None] Lock "cinder-ae786721-0dc4-4e3c-9096-db5aca7a2089-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:17:31 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-dbbeea27-2455-43ee-aff4-845f995cf428 tempest-VolumesGetTest-1307359977 None] Acquiring lock "cinder-quobyte-ae786721-0dc4-4e3c-9096-db5aca7a2089" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:17:31 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-dad1701c-b0a9-4383-868c-101203e6a4aa 1073741824" returned: 0 in 1.432s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:31 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-dbbeea27-2455-43ee-aff4-845f995cf428 tempest-VolumesGetTest-1307359977 None] Lock "cinder-quobyte-ae786721-0dc4-4e3c-9096-db5aca7a2089" acquired by "delete_volume" :: waited 0.048s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:17:31 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-49d367f8-dc80-456a-b63c-8bb667981734 tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.219s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:31 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-49d367f8-dc80-456a-b63c-8bb667981734 tempest-VolumesGetTest-1307359977 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:17:31 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-49d367f8-dc80-456a-b63c-8bb667981734 tempest-VolumesGetTest-1307359977 None] Deleted volume successfully. Jun 29 11:17:31 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9a829c-5e46-4666-a384-caa1fe00d872]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:17:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dbbeea27-2455-43ee-aff4-845f995cf428 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-dad1701c-b0a9-4383-868c-101203e6a4aa {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:31 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-49d367f8-dc80-456a-b63c-8bb667981734 tempest-VolumesGetTest-1307359977 None] Lock "cinder-f3b4172e-17e0-4e53-bc48-508809b5306b-delete_volume" released by "delete_volume" :: held 4.039s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:17:31 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-dad1701c-b0a9-4383-868c-101203e6a4aa Jun 29 11:17:31 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:31 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089 Jun 29 11:17:31 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:31 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-7023bb9c-51bc-4d2f-ba5c-66d975ee3cd3 req-e4b3fe81-c73f-4ad3-aa40-6624eb80f3b2 tempest-VolumesSnapshotsTestJSON-772230405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d.4a476222-9581-4a3f-91de-014f5d5841a6" returned: 0 in 1.298s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:31 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [req-7023bb9c-51bc-4d2f-ba5c-66d975ee3cd3 req-e4b3fe81-c73f-4ad3-aa40-6624eb80f3b2 tempest-VolumesSnapshotsTestJSON-772230405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8312f87-24bb-4955-9264-155fd1a4eb1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:17:31 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd61068-97a2-4d1e-91b6-66fbab3295ee]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:17:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-7023bb9c-51bc-4d2f-ba5c-66d975ee3cd3 req-e4b3fe81-c73f-4ad3-aa40-6624eb80f3b2 tempest-VolumesSnapshotsTestJSON-772230405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:32 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d Jun 29 11:17:32 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:32 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-dad1701c-b0a9-4383-868c-101203e6a4aa" returned: 0 in 0.905s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:32 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] <== create_volume: return (2508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:17:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.511s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:32 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d97fe13-875c-4f3a-8aed-0e93e19d9a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dad1701c-b0a9-4383-868c-101203e6a4aa', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:32 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6111fe30-c985-4a17-b9c7-1f9524834ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:32 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] Volume volume-dad1701c-b0a9-4383-868c-101203e6a4aa (dad1701c-b0a9-4383-868c-101203e6a4aa): created successfully Jun 29 11:17:32 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6111fe30-c985-4a17-b9c7-1f9524834ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:32 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] Flow 'volume_create_manager' (ee3abc99-d7a1-405a-96bc-785080a98a8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:17:32 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-c5e4f23d-a3d1-454c-8986-bbeeb7fc938e tempest-VolumesTransfersV355Test-197389201 None] Created volume successfully. Jun 29 11:17:32 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dbbeea27-2455-43ee-aff4-845f995cf428 tempest-VolumesGetTest-1307359977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089" returned: 0 in 1.336s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dbbeea27-2455-43ee-aff4-845f995cf428 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:32 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089 Jun 29 11:17:32 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:32 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-7023bb9c-51bc-4d2f-ba5c-66d975ee3cd3 req-e4b3fe81-c73f-4ad3-aa40-6624eb80f3b2 tempest-VolumesSnapshotsTestJSON-772230405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d" returned: 0 in 1.051s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-7023bb9c-51bc-4d2f-ba5c-66d975ee3cd3 req-e4b3fe81-c73f-4ad3-aa40-6624eb80f3b2 tempest-VolumesSnapshotsTestJSON-772230405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d.4a476222-9581-4a3f-91de-014f5d5841a6 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:32 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d.4a476222-9581-4a3f-91de-014f5d5841a6 Jun 29 11:17:32 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] Flow 'volume_create_manager' (1c738c7f-b6a5-46af-bad9-7fb69896a45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (457ed3d4-bca5-4866-b78a-070542f3244f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (457ed3d4-bca5-4866-b78a-070542f3244f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-896371366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ccad64-0e68-47d3-b1c4-d148b0096998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79df42fb557743128361944935d29124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:17:33Z,use_quota=True,user_id='99149d68809b43dca5c404de8037c846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b768197e-62e8-48aa-a739-1c78f7cfe45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b768197e-62e8-48aa-a739-1c78f7cfe45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed321c3-5752-4b08-8e41-37970a16fde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed321c3-5752-4b08-8e41-37970a16fde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73ccad64-0e68-47d3-b1c4-d148b0096998', 'volume_name': 'volume-73ccad64-0e68-47d3-b1c4-d148b0096998', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f62f81c5-fb5f-41b7-83c7-2f24273476b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f62f81c5-fb5f-41b7-83c7-2f24273476b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45c47a44-e4ad-4377-956e-ed1537b951d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:33 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] Volume 73ccad64-0e68-47d3-b1c4-d148b0096998: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73ccad64-0e68-47d3-b1c4-d148b0096998', 'volume_size': 1} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-896371366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ccad64-0e68-47d3-b1c4-d148b0096998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79df42fb557743128361944935d29124',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:17:33Z,use_quota=True,user_id='99149d68809b43dca5c404de8037c846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] Creating volume 73ccad64-0e68-47d3-b1c4-d148b0096998 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:17:33 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-73ccad64-0e68-47d3-b1c4-d148b0096998 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:33 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-73ccad64-0e68-47d3-b1c4-d148b0096998 1073741824 Jun 29 11:17:33 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-00aa8a2e-2bdd-426f-a424-6bda3a8c9d78 tempest-VolumesTransfersV355Test-117249035 None] Acquiring lock "cinder-dad1701c-b0a9-4383-868c-101203e6a4aa-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-00aa8a2e-2bdd-426f-a424-6bda3a8c9d78 tempest-VolumesTransfersV355Test-117249035 None] Lock "cinder-dad1701c-b0a9-4383-868c-101203e6a4aa-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-00aa8a2e-2bdd-426f-a424-6bda3a8c9d78 tempest-VolumesTransfersV355Test-117249035 None] Acquiring lock "cinder-quobyte-dad1701c-b0a9-4383-868c-101203e6a4aa" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:17:33 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-00aa8a2e-2bdd-426f-a424-6bda3a8c9d78 tempest-VolumesTransfersV355Test-117249035 None] Lock "cinder-quobyte-dad1701c-b0a9-4383-868c-101203e6a4aa" acquired by "delete_volume" :: waited 0.023s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dbbeea27-2455-43ee-aff4-845f995cf428 tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ae786721-0dc4-4e3c-9096-db5aca7a2089" returned: 0 in 1.029s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e50569c-79d8-4453-bd3b-3d5fccadbb94]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-00aa8a2e-2bdd-426f-a424-6bda3a8c9d78 tempest-VolumesTransfersV355Test-117249035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-dad1701c-b0a9-4383-868c-101203e6a4aa {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-dbbeea27-2455-43ee-aff4-845f995cf428 tempest-VolumesGetTest-1307359977 None] Lock "cinder-quobyte-ae786721-0dc4-4e3c-9096-db5aca7a2089" released by "delete_volume" :: held 2.500s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-dbbeea27-2455-43ee-aff4-845f995cf428 tempest-VolumesGetTest-1307359977 None] Created reservations ['98f7f963-66ac-4ee5-8311-03fa7da06b07', '7c8ab762-beae-45f7-87ca-9cb7613c95d8', '62cf679d-ccf4-42e0-97df-400913a77967', 'aeb07812-442c-4ee9-bd43-78b1de0e43cc'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:17:33 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-dad1701c-b0a9-4383-868c-101203e6a4aa Jun 29 11:17:33 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-dbbeea27-2455-43ee-aff4-845f995cf428 tempest-VolumesGetTest-1307359977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-dbbeea27-2455-43ee-aff4-845f995cf428 tempest-VolumesGetTest-1307359977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-dbbeea27-2455-43ee-aff4-845f995cf428 tempest-VolumesGetTest-1307359977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-dbbeea27-2455-43ee-aff4-845f995cf428 tempest-VolumesGetTest-1307359977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-dbbeea27-2455-43ee-aff4-845f995cf428 tempest-VolumesGetTest-1307359977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dbbeea27-2455-43ee-aff4-845f995cf428 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:33 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:17:33 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:34 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-7023bb9c-51bc-4d2f-ba5c-66d975ee3cd3 req-e4b3fe81-c73f-4ad3-aa40-6624eb80f3b2 tempest-VolumesSnapshotsTestJSON-772230405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d.4a476222-9581-4a3f-91de-014f5d5841a6" returned: 0 in 1.183s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-7023bb9c-51bc-4d2f-ba5c-66d975ee3cd3 req-e4b3fe81-c73f-4ad3-aa40-6624eb80f3b2 tempest-VolumesSnapshotsTestJSON-772230405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d.4a476222-9581-4a3f-91de-014f5d5841a6 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:34 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d.4a476222-9581-4a3f-91de-014f5d5841a6 Jun 29 11:17:34 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:34 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-00aa8a2e-2bdd-426f-a424-6bda3a8c9d78 tempest-VolumesTransfersV355Test-117249035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-dad1701c-b0a9-4383-868c-101203e6a4aa" returned: 0 in 1.136s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-00aa8a2e-2bdd-426f-a424-6bda3a8c9d78 tempest-VolumesTransfersV355Test-117249035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-dad1701c-b0a9-4383-868c-101203e6a4aa {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:34 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-dad1701c-b0a9-4383-868c-101203e6a4aa Jun 29 11:17:34 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:34 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-73ccad64-0e68-47d3-b1c4-d148b0096998 1073741824" returned: 0 in 1.587s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-73ccad64-0e68-47d3-b1c4-d148b0096998 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:35 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-73ccad64-0e68-47d3-b1c4-d148b0096998 Jun 29 11:17:35 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:35 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dbbeea27-2455-43ee-aff4-845f995cf428 tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.457s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:35 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-dbbeea27-2455-43ee-aff4-845f995cf428 tempest-VolumesGetTest-1307359977 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:17:35 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-dbbeea27-2455-43ee-aff4-845f995cf428 tempest-VolumesGetTest-1307359977 None] Deleted volume successfully. Jun 29 11:17:35 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-dbbeea27-2455-43ee-aff4-845f995cf428 tempest-VolumesGetTest-1307359977 None] Lock "cinder-ae786721-0dc4-4e3c-9096-db5aca7a2089-delete_volume" released by "delete_volume" :: held 4.373s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:17:35 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-7023bb9c-51bc-4d2f-ba5c-66d975ee3cd3 req-e4b3fe81-c73f-4ad3-aa40-6624eb80f3b2 tempest-VolumesSnapshotsTestJSON-772230405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d.4a476222-9581-4a3f-91de-014f5d5841a6" returned: 0 in 1.260s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:35 devstack cinder-volume[93497]: DEBUG cinder.coordination [req-7023bb9c-51bc-4d2f-ba5c-66d975ee3cd3 req-e4b3fe81-c73f-4ad3-aa40-6624eb80f3b2 tempest-VolumesSnapshotsTestJSON-772230405 None] Lock "cinder-quobyte-4a476222-9581-4a3f-91de-014f5d5841a6" released by "_delete_snapshot" :: held 4.979s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:17:35 devstack cinder-volume[93497]: DEBUG cinder.coordination [req-7023bb9c-51bc-4d2f-ba5c-66d975ee3cd3 req-e4b3fe81-c73f-4ad3-aa40-6624eb80f3b2 tempest-VolumesSnapshotsTestJSON-772230405 None] Lock "cinder-quobyte-b8312f87-24bb-4955-9264-155fd1a4eb1d" released by "delete_snapshot" :: held 5.036s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:17:35 devstack cinder-volume[93497]: DEBUG cinder.quota [req-7023bb9c-51bc-4d2f-ba5c-66d975ee3cd3 req-e4b3fe81-c73f-4ad3-aa40-6624eb80f3b2 tempest-VolumesSnapshotsTestJSON-772230405 None] Created reservations ['1cfcc5e0-2b05-4d8b-954c-ece56d1a268b', '706ba049-15eb-476a-9d8c-cbdf1a22a9ea', '42cb3e00-b018-4a13-8ca0-0db7ad24e03d', 'c8bced54-cd2e-41a5-b1d5-a7b6a7d7a133'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:17:35 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-7023bb9c-51bc-4d2f-ba5c-66d975ee3cd3 req-e4b3fe81-c73f-4ad3-aa40-6624eb80f3b2 tempest-VolumesSnapshotsTestJSON-772230405 None] Delete snapshot completed successfully. Jun 29 11:17:35 devstack cinder-volume[93497]: DEBUG cinder.coordination [req-7023bb9c-51bc-4d2f-ba5c-66d975ee3cd3 req-e4b3fe81-c73f-4ad3-aa40-6624eb80f3b2 tempest-VolumesSnapshotsTestJSON-772230405 None] Lock "cinder-4a476222-9581-4a3f-91de-014f5d5841a6-delete_snapshot" released by "delete_snapshot" :: held 5.320s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:17:35 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-00aa8a2e-2bdd-426f-a424-6bda3a8c9d78 tempest-VolumesTransfersV355Test-117249035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-dad1701c-b0a9-4383-868c-101203e6a4aa" returned: 0 in 1.172s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:35 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-00aa8a2e-2bdd-426f-a424-6bda3a8c9d78 tempest-VolumesTransfersV355Test-117249035 None] Lock "cinder-quobyte-dad1701c-b0a9-4383-868c-101203e6a4aa" released by "delete_volume" :: held 2.378s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:17:36 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-00aa8a2e-2bdd-426f-a424-6bda3a8c9d78 tempest-VolumesTransfersV355Test-117249035 None] Created reservations ['7319698e-d156-48bc-bdb2-35ed5dff0882', '9f817af7-5c17-4e1e-97c9-4894b91c4657', '3d2a41b4-fc3d-4b8d-a3ed-7b3da76ded0d', 'c4a18978-3a33-4ff3-a30f-7453cc0b0ac5'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:17:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [req-75d4a6c3-0da7-4182-a1c7-1aa659e9511b req-6e13566c-25a9-4f29-be4b-f2f804c0cb41 tempest-VolumesSnapshotsTestJSON-772230405 None] Acquiring lock "cinder-b8312f87-24bb-4955-9264-155fd1a4eb1d-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:17:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-00aa8a2e-2bdd-426f-a424-6bda3a8c9d78 tempest-VolumesTransfersV355Test-117249035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-00aa8a2e-2bdd-426f-a424-6bda3a8c9d78 tempest-VolumesTransfersV355Test-117249035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:36 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-00aa8a2e-2bdd-426f-a424-6bda3a8c9d78 tempest-VolumesTransfersV355Test-117249035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:17:36 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-00aa8a2e-2bdd-426f-a424-6bda3a8c9d78 tempest-VolumesTransfersV355Test-117249035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:17:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-00aa8a2e-2bdd-426f-a424-6bda3a8c9d78 tempest-VolumesTransfersV355Test-117249035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-00aa8a2e-2bdd-426f-a424-6bda3a8c9d78 tempest-VolumesTransfersV355Test-117249035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [req-75d4a6c3-0da7-4182-a1c7-1aa659e9511b req-6e13566c-25a9-4f29-be4b-f2f804c0cb41 tempest-VolumesSnapshotsTestJSON-772230405 None] Lock "cinder-b8312f87-24bb-4955-9264-155fd1a4eb1d-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:17:36 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:17:36 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:36 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-73ccad64-0e68-47d3-b1c4-d148b0096998" returned: 0 in 1.485s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:36 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] <== create_volume: return (3204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:17:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.210s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [req-75d4a6c3-0da7-4182-a1c7-1aa659e9511b req-6e13566c-25a9-4f29-be4b-f2f804c0cb41 tempest-VolumesSnapshotsTestJSON-772230405 None] Acquiring lock "cinder-quobyte-b8312f87-24bb-4955-9264-155fd1a4eb1d" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:17:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45c47a44-e4ad-4377-956e-ed1537b951d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73ccad64-0e68-47d3-b1c4-d148b0096998', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a6dc49-156b-40c0-a7af-62ccd191d928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [req-75d4a6c3-0da7-4182-a1c7-1aa659e9511b req-6e13566c-25a9-4f29-be4b-f2f804c0cb41 tempest-VolumesSnapshotsTestJSON-772230405 None] Lock "cinder-quobyte-b8312f87-24bb-4955-9264-155fd1a4eb1d" acquired by "delete_volume" :: waited 0.055s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:17:36 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] Volume volume-73ccad64-0e68-47d3-b1c4-d148b0096998 (73ccad64-0e68-47d3-b1c4-d148b0096998): created successfully Jun 29 11:17:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13a6dc49-156b-40c0-a7af-62ccd191d928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] Flow 'volume_create_manager' (1c738c7f-b6a5-46af-bad9-7fb69896a45c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:17:36 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5966ac35-a39d-47dd-9dbb-916c735b47f5]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:17:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-75d4a6c3-0da7-4182-a1c7-1aa659e9511b req-6e13566c-25a9-4f29-be4b-f2f804c0cb41 tempest-VolumesSnapshotsTestJSON-772230405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:36 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-903c6ba3-bb3b-4d21-8e2f-5b3def4c56ac tempest-TestMinimumBasicScenario-191147528 None] Created volume successfully. Jun 29 11:17:36 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:17:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Flow 'volume_create_manager' (fcd9ec1a-31bd-4fdb-9e48-b938beb6ecab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:17:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01dda743-c334-43fb-ad27-2b2a00b6113d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01dda743-c334-43fb-ad27-2b2a00b6113d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2128659359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=015929b2-815e-4b92-8f52-5f0ba630c402,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='61e86266cdf3432fa02a008cf313fac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:17:36Z,use_quota=True,user_id='77e05219ad094f72a78097d245f210a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ce5630c-152f-49ca-9733-7754841a9b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ce5630c-152f-49ca-9733-7754841a9b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b72372d-c1cc-4398-937c-c9d491be7742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:36 devstack cinder-volume[93497]: DEBUG cinder.image.glance [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Creating Keystone auth plugin from conf {{(pid=93497) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 29 11:17:36 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d Jun 29 11:17:36 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:37 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b72372d-c1cc-4398-937c-c9d491be7742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '015929b2-815e-4b92-8f52-5f0ba630c402', 'volume_name': 'volume-015929b2-815e-4b92-8f52-5f0ba630c402', 'volume_size': 1, 'image_id': 'e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '376ed9c5d02d4ab0be650a3f1fd75615', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'created_at': datetime.datetime(2026, 6, 29, 8, 56, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 8, 56, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:37 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b24edf26-8902-4c88-93fd-c586b72f052e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:37 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b24edf26-8902-4c88-93fd-c586b72f052e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:37 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85c44911-1f7d-4364-b706-916516105f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:37 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Volume 015929b2-815e-4b92-8f52-5f0ba630c402: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-015929b2-815e-4b92-8f52-5f0ba630c402', 'volume_size': 1, 'image_id': 'e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '376ed9c5d02d4ab0be650a3f1fd75615', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'created_at': datetime.datetime(2026, 6, 29, 8, 56, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 8, 56, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 29 11:17:37 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Trying to clone 015929b2-815e-4b92-8f52-5f0ba630c402 from image e2b32301-75fb-4235-bdc7-d391d7ce88e1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'metadata': {}}]). {{(pid=93497) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 29 11:17:37 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-00aa8a2e-2bdd-426f-a424-6bda3a8c9d78 tempest-VolumesTransfersV355Test-117249035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.077s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:37 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-00aa8a2e-2bdd-426f-a424-6bda3a8c9d78 tempest-VolumesTransfersV355Test-117249035 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:17:37 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-00aa8a2e-2bdd-426f-a424-6bda3a8c9d78 tempest-VolumesTransfersV355Test-117249035 None] Deleted volume successfully. Jun 29 11:17:37 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-00aa8a2e-2bdd-426f-a424-6bda3a8c9d78 tempest-VolumesTransfersV355Test-117249035 None] Lock "cinder-dad1701c-b0a9-4383-868c-101203e6a4aa-delete_volume" released by "delete_volume" :: held 4.094s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:17:37 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_01p8b6l1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93497) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 29 11:17:37 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Image download 20.69 MB at 20.69 MB/s Jun 29 11:17:37 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[51af01f5-dfa7-422b-b1da-ade4e87bb313]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:17:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_01p8b6l1devstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:37 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-75d4a6c3-0da7-4182-a1c7-1aa659e9511b req-6e13566c-25a9-4f29-be4b-f2f804c0cb41 tempest-VolumesSnapshotsTestJSON-772230405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d" returned: 0 in 1.405s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-75d4a6c3-0da7-4182-a1c7-1aa659e9511b req-6e13566c-25a9-4f29-be4b-f2f804c0cb41 tempest-VolumesSnapshotsTestJSON-772230405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:38 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d Jun 29 11:17:38 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:38 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_01p8b6l1devstack@QuobyteHD Jun 29 11:17:38 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:38 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_01p8b6l1devstack@QuobyteHD" returned: 0 in 0.866s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:38 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Temporary image e2b32301-75fb-4235-bdc7-d391d7ce88e1 is fetched for user 77e05219ad094f72a78097d245f210a7. {{(pid=93497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 29 11:17:38 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1a2aba-be95-47a8-9de9-7f821298b334]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:17:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_01p8b6l1devstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:39 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-75d4a6c3-0da7-4182-a1c7-1aa659e9511b req-6e13566c-25a9-4f29-be4b-f2f804c0cb41 tempest-VolumesSnapshotsTestJSON-772230405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b8312f87-24bb-4955-9264-155fd1a4eb1d" returned: 0 in 1.093s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:39 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_01p8b6l1devstack@QuobyteHD Jun 29 11:17:39 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:39 devstack cinder-volume[93497]: DEBUG cinder.coordination [req-75d4a6c3-0da7-4182-a1c7-1aa659e9511b req-6e13566c-25a9-4f29-be4b-f2f804c0cb41 tempest-VolumesSnapshotsTestJSON-772230405 None] Lock "cinder-quobyte-b8312f87-24bb-4955-9264-155fd1a4eb1d" released by "delete_volume" :: held 2.598s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:17:39 devstack cinder-volume[93497]: DEBUG cinder.quota [req-75d4a6c3-0da7-4182-a1c7-1aa659e9511b req-6e13566c-25a9-4f29-be4b-f2f804c0cb41 tempest-VolumesSnapshotsTestJSON-772230405 None] Created reservations ['6bc8473a-1835-4b5b-baef-e35a18a70694', 'eb98ee91-1fad-4d8a-acf7-fb7b27f99b83', '0d63299c-2baa-439a-ad26-2b59bc84c6e5', 'e46a1c2a-e2ae-4a4c-8ed6-d78e64fb08e8'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:17:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-75d4a6c3-0da7-4182-a1c7-1aa659e9511b req-6e13566c-25a9-4f29-be4b-f2f804c0cb41 tempest-VolumesSnapshotsTestJSON-772230405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-75d4a6c3-0da7-4182-a1c7-1aa659e9511b req-6e13566c-25a9-4f29-be4b-f2f804c0cb41 tempest-VolumesSnapshotsTestJSON-772230405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:39 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [req-75d4a6c3-0da7-4182-a1c7-1aa659e9511b req-6e13566c-25a9-4f29-be4b-f2f804c0cb41 tempest-VolumesSnapshotsTestJSON-772230405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:17:39 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [req-75d4a6c3-0da7-4182-a1c7-1aa659e9511b req-6e13566c-25a9-4f29-be4b-f2f804c0cb41 tempest-VolumesSnapshotsTestJSON-772230405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:17:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-75d4a6c3-0da7-4182-a1c7-1aa659e9511b req-6e13566c-25a9-4f29-be4b-f2f804c0cb41 tempest-VolumesSnapshotsTestJSON-772230405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-75d4a6c3-0da7-4182-a1c7-1aa659e9511b req-6e13566c-25a9-4f29-be4b-f2f804c0cb41 tempest-VolumesSnapshotsTestJSON-772230405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:39 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:17:39 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:40 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_01p8b6l1devstack@QuobyteHD" returned: 0 in 1.191s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:40 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2128659359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=015929b2-815e-4b92-8f52-5f0ba630c402,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='61e86266cdf3432fa02a008cf313fac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:17:36Z,use_quota=True,user_id='77e05219ad094f72a78097d245f210a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:17:40 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Creating volume 015929b2-815e-4b92-8f52-5f0ba630c402 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:17:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:40 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:17:40 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:17:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:40 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:17:40 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:17:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-015929b2-815e-4b92-8f52-5f0ba630c402 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:40 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-015929b2-815e-4b92-8f52-5f0ba630c402 1073741824 Jun 29 11:17:40 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:40 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-75d4a6c3-0da7-4182-a1c7-1aa659e9511b req-6e13566c-25a9-4f29-be4b-f2f804c0cb41 tempest-VolumesSnapshotsTestJSON-772230405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.278s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:40 devstack cinder-volume[93497]: DEBUG cinder.manager [req-75d4a6c3-0da7-4182-a1c7-1aa659e9511b req-6e13566c-25a9-4f29-be4b-f2f804c0cb41 tempest-VolumesSnapshotsTestJSON-772230405 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:17:40 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-75d4a6c3-0da7-4182-a1c7-1aa659e9511b req-6e13566c-25a9-4f29-be4b-f2f804c0cb41 tempest-VolumesSnapshotsTestJSON-772230405 None] Deleted volume successfully. Jun 29 11:17:40 devstack cinder-volume[93497]: DEBUG cinder.coordination [req-75d4a6c3-0da7-4182-a1c7-1aa659e9511b req-6e13566c-25a9-4f29-be4b-f2f804c0cb41 tempest-VolumesSnapshotsTestJSON-772230405 None] Lock "cinder-b8312f87-24bb-4955-9264-155fd1a4eb1d-delete_volume" released by "delete_volume" :: held 4.280s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:17:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-15d38171-c492-416c-80d4-5b8ef6708a18 req-9bb87d23-aa56-4cae-9013-381baa21cd41 tempest-TestMinimumBasicScenario-191147528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:41 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-015929b2-815e-4b92-8f52-5f0ba630c402 1073741824" returned: 0 in 1.461s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-015929b2-815e-4b92-8f52-5f0ba630c402 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:41 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-015929b2-815e-4b92-8f52-5f0ba630c402 Jun 29 11:17:41 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:42 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-015929b2-815e-4b92-8f52-5f0ba630c402" returned: 0 in 0.811s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:42 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] <== create_volume: return (2364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:17:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.373s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-15d38171-c492-416c-80d4-5b8ef6708a18 req-9bb87d23-aa56-4cae-9013-381baa21cd41 tempest-TestMinimumBasicScenario-191147528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.036s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:42 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02b9354-439a-4b8e-8751-e8d52637ea85]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:17:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-15d38171-c492-416c-80d4-5b8ef6708a18 req-9bb87d23-aa56-4cae-9013-381baa21cd41 tempest-TestMinimumBasicScenario-191147528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-73ccad64-0e68-47d3-b1c4-d148b0096998 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:42 devstack cinder-volume[93497]: DEBUG cinder.volume.volume_utils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Attempting download of e2b32301-75fb-4235-bdc7-d391d7ce88e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'metadata': {}}])) to volume 015929b2-815e-4b92-8f52-5f0ba630c402. {{(pid=93497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 29 11:17:42 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9e2ec4-4869-4258-a047-dece403a5f74]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:17:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2b32301-75fb-4235-bdc7-d391d7ce88e1_mkeqlyak {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:42 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-73ccad64-0e68-47d3-b1c4-d148b0096998 Jun 29 11:17:42 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:42 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2b32301-75fb-4235-bdc7-d391d7ce88e1_mkeqlyak Jun 29 11:17:42 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:43 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-15d38171-c492-416c-80d4-5b8ef6708a18 req-9bb87d23-aa56-4cae-9013-381baa21cd41 tempest-TestMinimumBasicScenario-191147528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-73ccad64-0e68-47d3-b1c4-d148b0096998" returned: 0 in 0.973s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-15d38171-c492-416c-80d4-5b8ef6708a18 req-9bb87d23-aa56-4cae-9013-381baa21cd41 tempest-TestMinimumBasicScenario-191147528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-15d38171-c492-416c-80d4-5b8ef6708a18 req-9bb87d23-aa56-4cae-9013-381baa21cd41 tempest-TestMinimumBasicScenario-191147528 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3', 'name': 'volume-73ccad64-0e68-47d3-b1c4-d148b0096998', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '76af970b-a256-4f5f-b23d-8b7e53598b78', 'enforce_multipath': True} {{(pid=93497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 11:17:43 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-15d38171-c492-416c-80d4-5b8ef6708a18 req-9bb87d23-aa56-4cae-9013-381baa21cd41 tempest-TestMinimumBasicScenario-191147528 None] attachment_update completed successfully. Jun 29 11:17:43 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2b32301-75fb-4235-bdc7-d391d7ce88e1_mkeqlyak" returned: 0 in 1.011s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2b32301-75fb-4235-bdc7-d391d7ce88e1_mkeqlyak {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:43 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2b32301-75fb-4235-bdc7-d391d7ce88e1_mkeqlyak Jun 29 11:17:43 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:44 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2b32301-75fb-4235-bdc7-d391d7ce88e1_mkeqlyak" returned: 1 in 0.797s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2b32301-75fb-4235-bdc7-d391d7ce88e1_mkeqlyak' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:17:44 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40a640f-ff49-4054-a748-beb0d7463e9f]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:17:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_01p8b6l1devstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:44 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_01p8b6l1devstack@QuobyteHD Jun 29 11:17:44 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:45 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_01p8b6l1devstack@QuobyteHD" returned: 0 in 0.842s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:45 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] e2b32301-75fb-4235-bdc7-d391d7ce88e1 was qcow2, converting to raw {{(pid=93497) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 29 11:17:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_01p8b6l1devstack@QuobyteHD /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-015929b2-815e-4b92-8f52-5f0ba630c402 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:45 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_01p8b6l1devstack@QuobyteHD /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-015929b2-815e-4b92-8f52-5f0ba630c402 Jun 29 11:17:45 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] Flow 'volume_create_manager' (4ab2aaf3-3148-4003-a3ba-7f874d779086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f101fa5-5807-4875-9d3b-1d2e4b02fed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f101fa5-5807-4875-9d3b-1d2e4b02fed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2074173575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c6a11b7-8a2a-4be2-a051-81628147e10d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc9f6b798e1d4b6a924dd670b4f2dbf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:17:46Z,use_quota=True,user_id='a121aa44dffa4a819d9ef92d233568a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fef5bfe-5bee-4639-a8f0-8f45c4a72aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fef5bfe-5bee-4639-a8f0-8f45c4a72aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f40663-6597-4a34-a089-c7f7563327b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f40663-6597-4a34-a089-c7f7563327b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c6a11b7-8a2a-4be2-a051-81628147e10d', 'volume_name': 'volume-3c6a11b7-8a2a-4be2-a051-81628147e10d', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd68d5e-f8ef-446a-b26a-c960cb7a907d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd68d5e-f8ef-446a-b26a-c960cb7a907d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c153a12-f630-41b6-bc48-c69f4d6b0e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:46 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] Volume 3c6a11b7-8a2a-4be2-a051-81628147e10d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c6a11b7-8a2a-4be2-a051-81628147e10d', 'volume_size': 1} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2074173575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c6a11b7-8a2a-4be2-a051-81628147e10d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc9f6b798e1d4b6a924dd670b4f2dbf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:17:46Z,use_quota=True,user_id='a121aa44dffa4a819d9ef92d233568a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] Creating volume 3c6a11b7-8a2a-4be2-a051-81628147e10d {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:17:46 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-3c6a11b7-8a2a-4be2-a051-81628147e10d 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:46 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-3c6a11b7-8a2a-4be2-a051-81628147e10d 1073741824 Jun 29 11:17:46 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] Flow 'volume_create_manager' (a1ecbe93-3a2c-4d7c-b231-a59241370bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50b6e2dc-0496-4e26-875e-0c32c4be5eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50b6e2dc-0496-4e26-875e-0c32c4be5eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1045850292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3dcc2e8-d6a8-4cca-9893-2142fadddcbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac3808b2c6ff45e1bedb68fc691c9f16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:17:47Z,use_quota=True,user_id='4218003303c645a3aa61e5784f724e66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d87dbd3-6e5f-4c54-a396-5e15d157888a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d87dbd3-6e5f-4c54-a396-5e15d157888a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e629f7-6b30-4203-aeb2-4fd91ff2b2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e629f7-6b30-4203-aeb2-4fd91ff2b2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3dcc2e8-d6a8-4cca-9893-2142fadddcbf', 'volume_name': 'volume-a3dcc2e8-d6a8-4cca-9893-2142fadddcbf', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (604c4991-33f4-4fa9-b4a8-11486dabb854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (604c4991-33f4-4fa9-b4a8-11486dabb854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8101fd6d-3426-442f-9e55-ca94c3debf06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:46 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] Volume a3dcc2e8-d6a8-4cca-9893-2142fadddcbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3dcc2e8-d6a8-4cca-9893-2142fadddcbf', 'volume_size': 1} Jun 29 11:17:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:47 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-3c6a11b7-8a2a-4be2-a051-81628147e10d 1073741824" returned: 0 in 0.974s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-3c6a11b7-8a2a-4be2-a051-81628147e10d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:47 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-3c6a11b7-8a2a-4be2-a051-81628147e10d Jun 29 11:17:47 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:47 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_01p8b6l1devstack@QuobyteHD /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-015929b2-815e-4b92-8f52-5f0ba630c402" returned: 0 in 2.209s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:47 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_01p8b6l1devstack@QuobyteHD, size 112.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-015929b2-815e-4b92-8f52-5f0ba630c402 {{(pid=93497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 11:17:47 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Converted 112.00 MB image at 50.67 MB/s Jun 29 11:17:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-015929b2-815e-4b92-8f52-5f0ba630c402 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:47 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-015929b2-815e-4b92-8f52-5f0ba630c402 1G Jun 29 11:17:47 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:48 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-3c6a11b7-8a2a-4be2-a051-81628147e10d" returned: 0 in 0.722s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:48 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:17:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.153s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:48 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1045850292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3dcc2e8-d6a8-4cca-9893-2142fadddcbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac3808b2c6ff45e1bedb68fc691c9f16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:17:47Z,use_quota=True,user_id='4218003303c645a3aa61e5784f724e66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:17:48 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] Creating volume a3dcc2e8-d6a8-4cca-9893-2142fadddcbf {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:17:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:48 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:17:48 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:17:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:48 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:17:48 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:17:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a3dcc2e8-d6a8-4cca-9893-2142fadddcbf 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:48 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a3dcc2e8-d6a8-4cca-9893-2142fadddcbf 1073741824 Jun 29 11:17:48 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:48 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c153a12-f630-41b6-bc48-c69f4d6b0e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c6a11b7-8a2a-4be2-a051-81628147e10d', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:48 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (340d2dac-4c04-4333-99a7-6aad5b01983a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:48 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] Volume volume-3c6a11b7-8a2a-4be2-a051-81628147e10d (3c6a11b7-8a2a-4be2-a051-81628147e10d): created successfully Jun 29 11:17:48 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (340d2dac-4c04-4333-99a7-6aad5b01983a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:48 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] Flow 'volume_create_manager' (4ab2aaf3-3148-4003-a3ba-7f874d779086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:17:48 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-f65a9bcb-9a79-49ed-a4a1-96e6adf69868 tempest-VolumesTestJSON-705776172 None] Created volume successfully. Jun 29 11:17:48 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-015929b2-815e-4b92-8f52-5f0ba630c402 1G" returned: 0 in 0.755s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:48 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2e1422-c1b4-4795-991b-ed4d28a13f26]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:17:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-015929b2-815e-4b92-8f52-5f0ba630c402 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:48 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-015929b2-815e-4b92-8f52-5f0ba630c402 Jun 29 11:17:48 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:49 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a3dcc2e8-d6a8-4cca-9893-2142fadddcbf 1073741824" returned: 0 in 1.284s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a3dcc2e8-d6a8-4cca-9893-2142fadddcbf {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:49 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a3dcc2e8-d6a8-4cca-9893-2142fadddcbf Jun 29 11:17:49 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:49 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-015929b2-815e-4b92-8f52-5f0ba630c402" returned: 0 in 1.214s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-015929b2-815e-4b92-8f52-5f0ba630c402 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:49 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:17:49 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] Flow 'volume_create_manager' (63950940-2662-44ed-9d8c-d848a6659c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:17:49 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81e83873-742d-4163-9103-cb0cb36edc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:49 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81e83873-742d-4163-9103-cb0cb36edc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-131740429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26235da4-ae08-4247-9464-ba2609c20bae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc9f6b798e1d4b6a924dd670b4f2dbf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:17:49Z,use_quota=True,user_id='a121aa44dffa4a819d9ef92d233568a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:49 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c702b2e3-ab7d-4ffe-8d5d-35aa5f7f5f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:49 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c702b2e3-ab7d-4ffe-8d5d-35aa5f7f5f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:49 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2675254d-ae6d-4cd6-b2a7-26dde920297f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:49 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-015929b2-815e-4b92-8f52-5f0ba630c402 Jun 29 11:17:49 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:49 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2675254d-ae6d-4cd6-b2a7-26dde920297f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26235da4-ae08-4247-9464-ba2609c20bae', 'volume_name': 'volume-26235da4-ae08-4247-9464-ba2609c20bae', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:49 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cae99aa-d563-4731-82e7-66c699a1d2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:49 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cae99aa-d563-4731-82e7-66c699a1d2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:49 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab03f354-c588-403f-a740-e9630e607761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:49 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] Volume 26235da4-ae08-4247-9464-ba2609c20bae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26235da4-ae08-4247-9464-ba2609c20bae', 'volume_size': 1} Jun 29 11:17:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:50 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a3dcc2e8-d6a8-4cca-9893-2142fadddcbf" returned: 0 in 0.799s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] <== create_volume: return (2151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:17:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.154s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.540s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-131740429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26235da4-ae08-4247-9464-ba2609c20bae,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc9f6b798e1d4b6a924dd670b4f2dbf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:17:49Z,use_quota=True,user_id='a121aa44dffa4a819d9ef92d233568a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:17:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] Creating volume 26235da4-ae08-4247-9464-ba2609c20bae {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:17:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:17:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:17:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:17:50 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:17:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-26235da4-ae08-4247-9464-ba2609c20bae 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8101fd6d-3426-442f-9e55-ca94c3debf06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3dcc2e8-d6a8-4cca-9893-2142fadddcbf', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:50 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-26235da4-ae08-4247-9464-ba2609c20bae 1073741824 Jun 29 11:17:50 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac51bc19-a5b5-453c-ae49-306c9302c5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:50 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] Volume volume-a3dcc2e8-d6a8-4cca-9893-2142fadddcbf (a3dcc2e8-d6a8-4cca-9893-2142fadddcbf): created successfully Jun 29 11:17:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac51bc19-a5b5-453c-ae49-306c9302c5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] Flow 'volume_create_manager' (a1ecbe93-3a2c-4d7c-b231-a59241370bd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:17:50 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-973d1f77-a0ed-4457-9827-484d6c1b84cb tempest-VolumesTransfersV357Test-2015885519 None] Created volume successfully. Jun 29 11:17:50 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-015929b2-815e-4b92-8f52-5f0ba630c402" returned: 1 in 0.880s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-015929b2-815e-4b92-8f52-5f0ba630c402' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:17:50 devstack cinder-volume[93497]: DEBUG cinder.volume.volume_utils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Downloaded image e2b32301-75fb-4235-bdc7-d391d7ce88e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'metadata': {}}])) to volume 015929b2-815e-4b92-8f52-5f0ba630c402 successfully. {{(pid=93497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 29 11:17:50 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Temporary image e2b32301-75fb-4235-bdc7-d391d7ce88e1 for user 77e05219ad094f72a78097d245f210a7 is deleted. {{(pid=93497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 29 11:17:50 devstack cinder-volume[93497]: DEBUG cinder.volume.volume_utils [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Marking volume 015929b2-815e-4b92-8f52-5f0ba630c402 as bootable. {{(pid=93497) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 29 11:17:50 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Copying metadata from image e2b32301-75fb-4235-bdc7-d391d7ce88e1 to 015929b2-815e-4b92-8f52-5f0ba630c402. {{(pid=93497) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 29 11:17:50 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Creating volume glance metadata for volume 015929b2-815e-4b92-8f52-5f0ba630c402 backed by image e2b32301-75fb-4235-bdc7-d391d7ce88e1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93497) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 29 11:17:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85c44911-1f7d-4364-b706-916516105f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-015929b2-815e-4b92-8f52-5f0ba630c402', 'volume_size': 1, 'image_id': 'e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '376ed9c5d02d4ab0be650a3f1fd75615', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'created_at': datetime.datetime(2026, 6, 29, 8, 56, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 8, 56, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d6a008-d047-4dfe-864f-5050bb2a0887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:50 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Volume volume-015929b2-815e-4b92-8f52-5f0ba630c402 (015929b2-815e-4b92-8f52-5f0ba630c402): created successfully Jun 29 11:17:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d6a008-d047-4dfe-864f-5050bb2a0887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Flow 'volume_create_manager' (fcd9ec1a-31bd-4fdb-9e48-b938beb6ecab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:17:50 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-fa5ed67a-ebb2-4b5b-8ecd-ca6ee0cc48e3 tempest-VolumesGetTest-1307359977 None] Created volume successfully. Jun 29 11:17:51 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-26235da4-ae08-4247-9464-ba2609c20bae 1073741824" returned: 0 in 0.908s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-26235da4-ae08-4247-9464-ba2609c20bae {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:51 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-26235da4-ae08-4247-9464-ba2609c20bae Jun 29 11:17:51 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:52 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-385b95b8-8fb2-4345-99c9-37d3ece65b54 tempest-VolumesTransfersV357Test-565720249 None] Transfer volume completed successfully. Jun 29 11:17:52 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-26235da4-ae08-4247-9464-ba2609c20bae" returned: 0 in 0.981s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:52 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:17:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.935s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab03f354-c588-403f-a740-e9630e607761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26235da4-ae08-4247-9464-ba2609c20bae', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87c4f1df-3d47-4544-800f-52f7ab1c07f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:52 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] Volume volume-26235da4-ae08-4247-9464-ba2609c20bae (26235da4-ae08-4247-9464-ba2609c20bae): created successfully Jun 29 11:17:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87c4f1df-3d47-4544-800f-52f7ab1c07f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] Flow 'volume_create_manager' (63950940-2662-44ed-9d8c-d848a6659c18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:17:52 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-63a93fc1-7173-4e0d-ab86-9dbfd1b8d0ab tempest-VolumesTestJSON-705776172 None] Created volume successfully. Jun 29 11:17:52 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:17:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] Flow 'volume_create_manager' (fe63eca7-d7e7-4b58-94d0-33a8c606d2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:17:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b0d91c-2a08-4656-9997-7d7a4ebd963c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b0d91c-2a08-4656-9997-7d7a4ebd963c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:17:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-748237678',display_name='tempest-VolumesGetTest-Volume-2120065184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912388b0-7544-49d1-a98a-f1304b0fb493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e86266cdf3432fa02a008cf313fac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:17:53Z,use_quota=True,user_id='77e05219ad094f72a78097d245f210a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f20f8198-37f0-4503-b3f0-0e4ba0046075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f20f8198-37f0-4503-b3f0-0e4ba0046075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e545c3-c1f5-4620-abf3-6e451c079af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e545c3-c1f5-4620-abf3-6e451c079af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '912388b0-7544-49d1-a98a-f1304b0fb493', 'volume_name': 'volume-912388b0-7544-49d1-a98a-f1304b0fb493', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27159e19-0b74-4af9-8c88-d9645b89beed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27159e19-0b74-4af9-8c88-d9645b89beed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe22b8e-d447-44bb-a419-3cd57740dc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:53 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] Volume 912388b0-7544-49d1-a98a-f1304b0fb493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-912388b0-7544-49d1-a98a-f1304b0fb493', 'volume_size': 1} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:17:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-748237678',display_name='tempest-VolumesGetTest-Volume-2120065184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912388b0-7544-49d1-a98a-f1304b0fb493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61e86266cdf3432fa02a008cf313fac4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:17:53Z,use_quota=True,user_id='77e05219ad094f72a78097d245f210a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] Creating volume 912388b0-7544-49d1-a98a-f1304b0fb493 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:17:53 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-912388b0-7544-49d1-a98a-f1304b0fb493 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:53 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-912388b0-7544-49d1-a98a-f1304b0fb493 1073741824 Jun 29 11:17:53 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e58a1f38-a221-404b-8690-5e004d320fb5 tempest-VolumesTransfersV357Test-127274399 None] Acquiring lock "cinder-a3dcc2e8-d6a8-4cca-9893-2142fadddcbf-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e58a1f38-a221-404b-8690-5e004d320fb5 tempest-VolumesTransfersV357Test-127274399 None] Lock "cinder-a3dcc2e8-d6a8-4cca-9893-2142fadddcbf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e58a1f38-a221-404b-8690-5e004d320fb5 tempest-VolumesTransfersV357Test-127274399 None] Acquiring lock "cinder-quobyte-a3dcc2e8-d6a8-4cca-9893-2142fadddcbf" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e58a1f38-a221-404b-8690-5e004d320fb5 tempest-VolumesTransfersV357Test-127274399 None] Lock "cinder-quobyte-a3dcc2e8-d6a8-4cca-9893-2142fadddcbf" acquired by "delete_volume" :: waited 0.019s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aeebf7f-75e4-4a79-bc1a-d29ccecdcb41]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e58a1f38-a221-404b-8690-5e004d320fb5 tempest-VolumesTransfersV357Test-127274399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a3dcc2e8-d6a8-4cca-9893-2142fadddcbf {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:53 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a3dcc2e8-d6a8-4cca-9893-2142fadddcbf Jun 29 11:17:53 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] Flow 'volume_create_manager' (0bc59a16-bd94-473d-8e29-02490f2bbe31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f142b4db-a460-403b-b6a7-f4f1c23d5c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f142b4db-a460-403b-b6a7-f4f1c23d5c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-856566816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e67ab072-880d-4c45-a9d6-03a15d15d854,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc9f6b798e1d4b6a924dd670b4f2dbf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:17:54Z,use_quota=True,user_id='a121aa44dffa4a819d9ef92d233568a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (232350bf-4527-4f46-a5e1-2f5902bb59c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (232350bf-4527-4f46-a5e1-2f5902bb59c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (432bd10b-ea11-4e6c-83d6-28a4590adb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (432bd10b-ea11-4e6c-83d6-28a4590adb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e67ab072-880d-4c45-a9d6-03a15d15d854', 'volume_name': 'volume-e67ab072-880d-4c45-a9d6-03a15d15d854', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca7c2fe-052f-4047-ae0b-39bdf3ed1f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca7c2fe-052f-4047-ae0b-39bdf3ed1f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (516ddaf9-4f1c-451d-b3ab-fe02c0a15bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:53 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] Volume e67ab072-880d-4c45-a9d6-03a15d15d854: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e67ab072-880d-4c45-a9d6-03a15d15d854', 'volume_size': 1} Jun 29 11:17:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:54 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-912388b0-7544-49d1-a98a-f1304b0fb493 1073741824" returned: 0 in 1.103s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-912388b0-7544-49d1-a98a-f1304b0fb493 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:54 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-912388b0-7544-49d1-a98a-f1304b0fb493 Jun 29 11:17:54 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:54 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e58a1f38-a221-404b-8690-5e004d320fb5 tempest-VolumesTransfersV357Test-127274399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a3dcc2e8-d6a8-4cca-9893-2142fadddcbf" returned: 0 in 0.983s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e58a1f38-a221-404b-8690-5e004d320fb5 tempest-VolumesTransfersV357Test-127274399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a3dcc2e8-d6a8-4cca-9893-2142fadddcbf {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:54 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a3dcc2e8-d6a8-4cca-9893-2142fadddcbf Jun 29 11:17:54 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:54 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-912388b0-7544-49d1-a98a-f1304b0fb493" returned: 0 in 0.707s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:17:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.095s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-856566816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e67ab072-880d-4c45-a9d6-03a15d15d854,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc9f6b798e1d4b6a924dd670b4f2dbf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:17:54Z,use_quota=True,user_id='a121aa44dffa4a819d9ef92d233568a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:17:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] Creating volume e67ab072-880d-4c45-a9d6-03a15d15d854 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:17:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:17:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:17:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:17:54 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:17:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e67ab072-880d-4c45-a9d6-03a15d15d854 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:55 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e67ab072-880d-4c45-a9d6-03a15d15d854 1073741824 Jun 29 11:17:55 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe22b8e-d447-44bb-a419-3cd57740dc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-912388b0-7544-49d1-a98a-f1304b0fb493', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:55 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:55 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f097a82-73bc-455d-8127-3b4f2826d029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:55 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] Volume volume-912388b0-7544-49d1-a98a-f1304b0fb493 (912388b0-7544-49d1-a98a-f1304b0fb493): created successfully Jun 29 11:17:55 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f097a82-73bc-455d-8127-3b4f2826d029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:55 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] Flow 'volume_create_manager' (fe63eca7-d7e7-4b58-94d0-33a8c606d2c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:17:55 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-c7ef7eff-3f36-4a72-b538-39a951c9e762 tempest-VolumesGetTest-1307359977 None] Created volume successfully. Jun 29 11:17:55 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e58a1f38-a221-404b-8690-5e004d320fb5 tempest-VolumesTransfersV357Test-127274399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a3dcc2e8-d6a8-4cca-9893-2142fadddcbf" returned: 0 in 0.710s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e58a1f38-a221-404b-8690-5e004d320fb5 tempest-VolumesTransfersV357Test-127274399 None] Lock "cinder-quobyte-a3dcc2e8-d6a8-4cca-9893-2142fadddcbf" released by "delete_volume" :: held 1.760s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:17:55 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-e58a1f38-a221-404b-8690-5e004d320fb5 tempest-VolumesTransfersV357Test-127274399 None] Created reservations ['36999e21-0b53-44a3-841c-c6aa3d093d07', 'e646b547-ad28-4d32-831f-c0faf2c52717', '6ffdb937-7001-4c27-bcf8-c972cf6701c5', '470d23fc-7aa7-4dd3-a802-972fe33acb46'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:17:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e58a1f38-a221-404b-8690-5e004d320fb5 tempest-VolumesTransfersV357Test-127274399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e58a1f38-a221-404b-8690-5e004d320fb5 tempest-VolumesTransfersV357Test-127274399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:55 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-e58a1f38-a221-404b-8690-5e004d320fb5 tempest-VolumesTransfersV357Test-127274399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:17:55 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-e58a1f38-a221-404b-8690-5e004d320fb5 tempest-VolumesTransfersV357Test-127274399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:17:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e58a1f38-a221-404b-8690-5e004d320fb5 tempest-VolumesTransfersV357Test-127274399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e58a1f38-a221-404b-8690-5e004d320fb5 tempest-VolumesTransfersV357Test-127274399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:55 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:17:55 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:56 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e67ab072-880d-4c45-a9d6-03a15d15d854 1073741824" returned: 0 in 1.071s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e67ab072-880d-4c45-a9d6-03a15d15d854 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:56 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-eab679c7-505b-48ff-a5db-773a1188a8b3 tempest-VolumesGetTest-1307359977 None] Acquiring lock "cinder-912388b0-7544-49d1-a98a-f1304b0fb493-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:17:56 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e67ab072-880d-4c45-a9d6-03a15d15d854 Jun 29 11:17:56 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:56 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-eab679c7-505b-48ff-a5db-773a1188a8b3 tempest-VolumesGetTest-1307359977 None] Lock "cinder-912388b0-7544-49d1-a98a-f1304b0fb493-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:17:56 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-eab679c7-505b-48ff-a5db-773a1188a8b3 tempest-VolumesGetTest-1307359977 None] Acquiring lock "cinder-quobyte-912388b0-7544-49d1-a98a-f1304b0fb493" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:17:56 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-eab679c7-505b-48ff-a5db-773a1188a8b3 tempest-VolumesGetTest-1307359977 None] Lock "cinder-quobyte-912388b0-7544-49d1-a98a-f1304b0fb493" acquired by "delete_volume" :: waited 0.044s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:17:56 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf4f146-b377-45cd-ab7b-5cd116f59b99]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:17:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-eab679c7-505b-48ff-a5db-773a1188a8b3 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-912388b0-7544-49d1-a98a-f1304b0fb493 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:56 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e58a1f38-a221-404b-8690-5e004d320fb5 tempest-VolumesTransfersV357Test-127274399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.979s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:56 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-e58a1f38-a221-404b-8690-5e004d320fb5 tempest-VolumesTransfersV357Test-127274399 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:17:56 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-e58a1f38-a221-404b-8690-5e004d320fb5 tempest-VolumesTransfersV357Test-127274399 None] Deleted volume successfully. Jun 29 11:17:56 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e58a1f38-a221-404b-8690-5e004d320fb5 tempest-VolumesTransfersV357Test-127274399 None] Lock "cinder-a3dcc2e8-d6a8-4cca-9893-2142fadddcbf-delete_volume" released by "delete_volume" :: held 3.029s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:17:56 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-912388b0-7544-49d1-a98a-f1304b0fb493 Jun 29 11:17:56 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:56 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:17:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] Flow 'volume_create_manager' (d2f1c6a1-3c97-42f9-9622-d6bf540cc1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:17:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a79d126c-b4b6-4186-ba1e-848f38f7e52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a79d126c-b4b6-4186-ba1e-848f38f7e52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1375195302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59b93e9d-1eb8-4a76-9cae-09ca5922eb88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac3808b2c6ff45e1bedb68fc691c9f16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:17:57Z,use_quota=True,user_id='4218003303c645a3aa61e5784f724e66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e6a11d2-8561-422e-a0c5-e9d13d93a77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e6a11d2-8561-422e-a0c5-e9d13d93a77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63a97fc5-4bb1-4f87-8c7c-35946e383e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63a97fc5-4bb1-4f87-8c7c-35946e383e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59b93e9d-1eb8-4a76-9cae-09ca5922eb88', 'volume_name': 'volume-59b93e9d-1eb8-4a76-9cae-09ca5922eb88', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e3ed87f-858b-4d67-9993-925d9e1106d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e3ed87f-858b-4d67-9993-925d9e1106d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c429eefe-2fd7-4755-b584-43a819d5fcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:56 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] Volume 59b93e9d-1eb8-4a76-9cae-09ca5922eb88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59b93e9d-1eb8-4a76-9cae-09ca5922eb88', 'volume_size': 1} Jun 29 11:17:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:57 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e67ab072-880d-4c45-a9d6-03a15d15d854" returned: 0 in 0.927s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:57 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] <== create_volume: return (2081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:17:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.084s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.231s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:57 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1375195302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59b93e9d-1eb8-4a76-9cae-09ca5922eb88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac3808b2c6ff45e1bedb68fc691c9f16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:17:57Z,use_quota=True,user_id='4218003303c645a3aa61e5784f724e66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:17:57 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] Creating volume 59b93e9d-1eb8-4a76-9cae-09ca5922eb88 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:17:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:57 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:17:57 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:17:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:57 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:17:57 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:17:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-59b93e9d-1eb8-4a76-9cae-09ca5922eb88 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:57 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-59b93e9d-1eb8-4a76-9cae-09ca5922eb88 1073741824 Jun 29 11:17:57 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:57 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (516ddaf9-4f1c-451d-b3ab-fe02c0a15bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e67ab072-880d-4c45-a9d6-03a15d15d854', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:57 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac7d6e5-8065-415b-8bfe-8ed434eb3157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:57 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] Volume volume-e67ab072-880d-4c45-a9d6-03a15d15d854 (e67ab072-880d-4c45-a9d6-03a15d15d854): created successfully Jun 29 11:17:57 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac7d6e5-8065-415b-8bfe-8ed434eb3157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:57 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] Flow 'volume_create_manager' (0bc59a16-bd94-473d-8e29-02490f2bbe31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:17:57 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-5d9e8b0c-f278-4b36-bcb0-dacdb54c4c8b tempest-VolumesTestJSON-705776172 None] Created volume successfully. Jun 29 11:17:57 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-eab679c7-505b-48ff-a5db-773a1188a8b3 tempest-VolumesGetTest-1307359977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-912388b0-7544-49d1-a98a-f1304b0fb493" returned: 0 in 0.945s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-eab679c7-505b-48ff-a5db-773a1188a8b3 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-912388b0-7544-49d1-a98a-f1304b0fb493 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:57 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-912388b0-7544-49d1-a98a-f1304b0fb493 Jun 29 11:17:57 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:58 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-59b93e9d-1eb8-4a76-9cae-09ca5922eb88 1073741824" returned: 0 in 0.953s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:58 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-eab679c7-505b-48ff-a5db-773a1188a8b3 tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-912388b0-7544-49d1-a98a-f1304b0fb493" returned: 0 in 0.672s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-59b93e9d-1eb8-4a76-9cae-09ca5922eb88 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:58 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-eab679c7-505b-48ff-a5db-773a1188a8b3 tempest-VolumesGetTest-1307359977 None] Lock "cinder-quobyte-912388b0-7544-49d1-a98a-f1304b0fb493" released by "delete_volume" :: held 1.699s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:17:58 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-59b93e9d-1eb8-4a76-9cae-09ca5922eb88 Jun 29 11:17:58 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:58 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-eab679c7-505b-48ff-a5db-773a1188a8b3 tempest-VolumesGetTest-1307359977 None] Created reservations ['5082a05b-c133-4533-a2bd-e104ab23feba', '5d15711a-9c88-4f01-a8a1-401f6d283dbf', '930577c0-8d1e-40ea-9db3-5fe0f2650a6b', '029b1c8c-abd9-4352-b15d-3d1ba1581d84'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:17:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-eab679c7-505b-48ff-a5db-773a1188a8b3 tempest-VolumesGetTest-1307359977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:17:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-eab679c7-505b-48ff-a5db-773a1188a8b3 tempest-VolumesGetTest-1307359977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:17:58 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-eab679c7-505b-48ff-a5db-773a1188a8b3 tempest-VolumesGetTest-1307359977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:17:58 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-eab679c7-505b-48ff-a5db-773a1188a8b3 tempest-VolumesGetTest-1307359977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:17:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-eab679c7-505b-48ff-a5db-773a1188a8b3 tempest-VolumesGetTest-1307359977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-eab679c7-505b-48ff-a5db-773a1188a8b3 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:58 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:17:58 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:58 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f11bdf41-dd17-4608-bf74-31e8086e28e4 tempest-VolumesGetTest-1307359977 None] Acquiring lock "cinder-015929b2-815e-4b92-8f52-5f0ba630c402-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:17:58 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f11bdf41-dd17-4608-bf74-31e8086e28e4 tempest-VolumesGetTest-1307359977 None] Lock "cinder-015929b2-815e-4b92-8f52-5f0ba630c402-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:17:58 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f11bdf41-dd17-4608-bf74-31e8086e28e4 tempest-VolumesGetTest-1307359977 None] Acquiring lock "cinder-quobyte-015929b2-815e-4b92-8f52-5f0ba630c402" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:17:58 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f11bdf41-dd17-4608-bf74-31e8086e28e4 tempest-VolumesGetTest-1307359977 None] Lock "cinder-quobyte-015929b2-815e-4b92-8f52-5f0ba630c402" acquired by "delete_volume" :: waited 0.022s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:17:58 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52abea4-a7c8-4950-8a4a-39f13a7678da]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:17:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f11bdf41-dd17-4608-bf74-31e8086e28e4 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-015929b2-815e-4b92-8f52-5f0ba630c402 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:58 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-59b93e9d-1eb8-4a76-9cae-09ca5922eb88" returned: 0 in 0.846s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:58 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] <== create_volume: return (1865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:17:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.868s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:17:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c429eefe-2fd7-4755-b584-43a819d5fcf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59b93e9d-1eb8-4a76-9cae-09ca5922eb88', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c7201b1-7bdb-4227-bc93-2f149e32beca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:17:58 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] Volume volume-59b93e9d-1eb8-4a76-9cae-09ca5922eb88 (59b93e9d-1eb8-4a76-9cae-09ca5922eb88): created successfully Jun 29 11:17:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c7201b1-7bdb-4227-bc93-2f149e32beca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:17:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] Flow 'volume_create_manager' (d2f1c6a1-3c97-42f9-9622-d6bf540cc1e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:17:59 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-9877c662-3dc3-430e-be20-a16eb408647d tempest-VolumesTransfersV357Test-2015885519 None] Created volume successfully. Jun 29 11:17:59 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-015929b2-815e-4b92-8f52-5f0ba630c402 Jun 29 11:17:59 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:59 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:59 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-abb2ea43-11f5-4017-aee6-369ebcb2fdeb tempest-VolumesTestJSON-705776172 None] Acquiring lock "cinder-e67ab072-880d-4c45-a9d6-03a15d15d854-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:17:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-eab679c7-505b-48ff-a5db-773a1188a8b3 tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.858s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:59 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-eab679c7-505b-48ff-a5db-773a1188a8b3 tempest-VolumesGetTest-1307359977 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:17:59 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-eab679c7-505b-48ff-a5db-773a1188a8b3 tempest-VolumesGetTest-1307359977 None] Deleted volume successfully. Jun 29 11:17:59 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-abb2ea43-11f5-4017-aee6-369ebcb2fdeb tempest-VolumesTestJSON-705776172 None] Lock "cinder-e67ab072-880d-4c45-a9d6-03a15d15d854-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:17:59 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-eab679c7-505b-48ff-a5db-773a1188a8b3 tempest-VolumesGetTest-1307359977 None] Lock "cinder-912388b0-7544-49d1-a98a-f1304b0fb493-delete_volume" released by "delete_volume" :: held 2.974s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:17:59 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-abb2ea43-11f5-4017-aee6-369ebcb2fdeb tempest-VolumesTestJSON-705776172 None] Acquiring lock "cinder-quobyte-e67ab072-880d-4c45-a9d6-03a15d15d854" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:17:59 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-abb2ea43-11f5-4017-aee6-369ebcb2fdeb tempest-VolumesTestJSON-705776172 None] Lock "cinder-quobyte-e67ab072-880d-4c45-a9d6-03a15d15d854" acquired by "delete_volume" :: waited 0.018s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:17:59 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa2907a-ce97-4136-af83-9e1c07dc8a19]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:17:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-abb2ea43-11f5-4017-aee6-369ebcb2fdeb tempest-VolumesTestJSON-705776172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e67ab072-880d-4c45-a9d6-03a15d15d854 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:59 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e67ab072-880d-4c45-a9d6-03a15d15d854 Jun 29 11:17:59 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:17:59 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jun 29 11:17:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f11bdf41-dd17-4608-bf74-31e8086e28e4 tempest-VolumesGetTest-1307359977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-015929b2-815e-4b92-8f52-5f0ba630c402" returned: 0 in 0.856s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:17:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f11bdf41-dd17-4608-bf74-31e8086e28e4 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-015929b2-815e-4b92-8f52-5f0ba630c402 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:17:59 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-015929b2-815e-4b92-8f52-5f0ba630c402 Jun 29 11:17:59 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:00 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-abb2ea43-11f5-4017-aee6-369ebcb2fdeb tempest-VolumesTestJSON-705776172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e67ab072-880d-4c45-a9d6-03a15d15d854" returned: 0 in 0.893s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-abb2ea43-11f5-4017-aee6-369ebcb2fdeb tempest-VolumesTestJSON-705776172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e67ab072-880d-4c45-a9d6-03a15d15d854 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:00 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c67ebe78-3abc-4f53-b8e8-3907fc9a7f5f tempest-VolumesTransfersV357Test-127274399 None] Acquiring lock "cinder-59b93e9d-1eb8-4a76-9cae-09ca5922eb88-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:18:00 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e67ab072-880d-4c45-a9d6-03a15d15d854 Jun 29 11:18:00 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:00 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c67ebe78-3abc-4f53-b8e8-3907fc9a7f5f tempest-VolumesTransfersV357Test-127274399 None] Lock "cinder-59b93e9d-1eb8-4a76-9cae-09ca5922eb88-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:18:00 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c67ebe78-3abc-4f53-b8e8-3907fc9a7f5f tempest-VolumesTransfersV357Test-127274399 None] Acquiring lock "cinder-quobyte-59b93e9d-1eb8-4a76-9cae-09ca5922eb88" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:18:00 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c67ebe78-3abc-4f53-b8e8-3907fc9a7f5f tempest-VolumesTransfersV357Test-127274399 None] Lock "cinder-quobyte-59b93e9d-1eb8-4a76-9cae-09ca5922eb88" acquired by "delete_volume" :: waited 0.024s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:18:00 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f26e14-2ded-40c0-a07a-9d7f19ad0c66]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:18:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c67ebe78-3abc-4f53-b8e8-3907fc9a7f5f tempest-VolumesTransfersV357Test-127274399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-59b93e9d-1eb8-4a76-9cae-09ca5922eb88 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:00 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-59b93e9d-1eb8-4a76-9cae-09ca5922eb88 Jun 29 11:18:00 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:00 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f11bdf41-dd17-4608-bf74-31e8086e28e4 tempest-VolumesGetTest-1307359977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-015929b2-815e-4b92-8f52-5f0ba630c402" returned: 1 in 0.832s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f11bdf41-dd17-4608-bf74-31e8086e28e4 tempest-VolumesGetTest-1307359977 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-015929b2-815e-4b92-8f52-5f0ba630c402' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:18:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f11bdf41-dd17-4608-bf74-31e8086e28e4 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-015929b2-815e-4b92-8f52-5f0ba630c402 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:00 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-015929b2-815e-4b92-8f52-5f0ba630c402 Jun 29 11:18:00 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:01 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-abb2ea43-11f5-4017-aee6-369ebcb2fdeb tempest-VolumesTestJSON-705776172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e67ab072-880d-4c45-a9d6-03a15d15d854" returned: 0 in 0.858s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-abb2ea43-11f5-4017-aee6-369ebcb2fdeb tempest-VolumesTestJSON-705776172 None] Lock "cinder-quobyte-e67ab072-880d-4c45-a9d6-03a15d15d854" released by "delete_volume" :: held 1.793s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:18:01 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-abb2ea43-11f5-4017-aee6-369ebcb2fdeb tempest-VolumesTestJSON-705776172 None] Created reservations ['82dfc76f-7338-4fe8-b613-ed4f91aab535', '19f41d0a-4ad2-4ebd-8e92-2f212a845b98', '893297ae-185f-4e67-9b12-fb93f1134235', '1f7a59bc-583d-49a6-aebe-1b2b91d3ae91'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:18:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-abb2ea43-11f5-4017-aee6-369ebcb2fdeb tempest-VolumesTestJSON-705776172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:18:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-abb2ea43-11f5-4017-aee6-369ebcb2fdeb tempest-VolumesTestJSON-705776172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:18:01 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-abb2ea43-11f5-4017-aee6-369ebcb2fdeb tempest-VolumesTestJSON-705776172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:18:01 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-abb2ea43-11f5-4017-aee6-369ebcb2fdeb tempest-VolumesTestJSON-705776172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:18:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-abb2ea43-11f5-4017-aee6-369ebcb2fdeb tempest-VolumesTestJSON-705776172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:18:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-abb2ea43-11f5-4017-aee6-369ebcb2fdeb tempest-VolumesTestJSON-705776172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:01 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:18:01 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:01 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f11bdf41-dd17-4608-bf74-31e8086e28e4 tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-015929b2-815e-4b92-8f52-5f0ba630c402" returned: 0 in 0.685s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f11bdf41-dd17-4608-bf74-31e8086e28e4 tempest-VolumesGetTest-1307359977 None] Lock "cinder-quobyte-015929b2-815e-4b92-8f52-5f0ba630c402" released by "delete_volume" :: held 2.455s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:18:01 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-f11bdf41-dd17-4608-bf74-31e8086e28e4 tempest-VolumesGetTest-1307359977 None] Created reservations ['4d0297e0-e953-46eb-94b6-0d96467cada5', 'ebd07d30-14ab-4370-aa79-413dc4376017', 'f03271f7-5eb5-4dea-9105-0d92a0941e78', '01128075-3534-4ade-99ab-597c4d863cac'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:18:01 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c67ebe78-3abc-4f53-b8e8-3907fc9a7f5f tempest-VolumesTransfersV357Test-127274399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-59b93e9d-1eb8-4a76-9cae-09ca5922eb88" returned: 0 in 0.950s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c67ebe78-3abc-4f53-b8e8-3907fc9a7f5f tempest-VolumesTransfersV357Test-127274399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-59b93e9d-1eb8-4a76-9cae-09ca5922eb88 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:01 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-59b93e9d-1eb8-4a76-9cae-09ca5922eb88 Jun 29 11:18:01 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f11bdf41-dd17-4608-bf74-31e8086e28e4 tempest-VolumesGetTest-1307359977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:18:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f11bdf41-dd17-4608-bf74-31e8086e28e4 tempest-VolumesGetTest-1307359977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:18:01 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f11bdf41-dd17-4608-bf74-31e8086e28e4 tempest-VolumesGetTest-1307359977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:18:01 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f11bdf41-dd17-4608-bf74-31e8086e28e4 tempest-VolumesGetTest-1307359977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:18:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f11bdf41-dd17-4608-bf74-31e8086e28e4 tempest-VolumesGetTest-1307359977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:18:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f11bdf41-dd17-4608-bf74-31e8086e28e4 tempest-VolumesGetTest-1307359977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:01 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:18:01 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ebadd485-625a-492f-ae14-9fd562d128a7 tempest-VolumesTestJSON-705776172 None] Acquiring lock "cinder-26235da4-ae08-4247-9464-ba2609c20bae-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:18:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ebadd485-625a-492f-ae14-9fd562d128a7 tempest-VolumesTestJSON-705776172 None] Lock "cinder-26235da4-ae08-4247-9464-ba2609c20bae-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:18:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ebadd485-625a-492f-ae14-9fd562d128a7 tempest-VolumesTestJSON-705776172 None] Acquiring lock "cinder-quobyte-26235da4-ae08-4247-9464-ba2609c20bae" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:18:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ebadd485-625a-492f-ae14-9fd562d128a7 tempest-VolumesTestJSON-705776172 None] Lock "cinder-quobyte-26235da4-ae08-4247-9464-ba2609c20bae" acquired by "delete_volume" :: waited 0.024s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:18:01 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[086d74b8-056f-446c-b71b-0a18d034fd8d]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:18:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ebadd485-625a-492f-ae14-9fd562d128a7 tempest-VolumesTestJSON-705776172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-26235da4-ae08-4247-9464-ba2609c20bae {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:01 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-26235da4-ae08-4247-9464-ba2609c20bae Jun 29 11:18:01 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:01 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-abb2ea43-11f5-4017-aee6-369ebcb2fdeb tempest-VolumesTestJSON-705776172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.761s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:01 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-abb2ea43-11f5-4017-aee6-369ebcb2fdeb tempest-VolumesTestJSON-705776172 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:18:01 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-abb2ea43-11f5-4017-aee6-369ebcb2fdeb tempest-VolumesTestJSON-705776172 None] Deleted volume successfully. Jun 29 11:18:02 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-abb2ea43-11f5-4017-aee6-369ebcb2fdeb tempest-VolumesTestJSON-705776172 None] Lock "cinder-e67ab072-880d-4c45-a9d6-03a15d15d854-delete_volume" released by "delete_volume" :: held 2.836s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:18:02 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c67ebe78-3abc-4f53-b8e8-3907fc9a7f5f tempest-VolumesTransfersV357Test-127274399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-59b93e9d-1eb8-4a76-9cae-09ca5922eb88" returned: 0 in 1.016s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:02 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c67ebe78-3abc-4f53-b8e8-3907fc9a7f5f tempest-VolumesTransfersV357Test-127274399 None] Lock "cinder-quobyte-59b93e9d-1eb8-4a76-9cae-09ca5922eb88" released by "delete_volume" :: held 2.066s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:18:02 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-c67ebe78-3abc-4f53-b8e8-3907fc9a7f5f tempest-VolumesTransfersV357Test-127274399 None] Created reservations ['d8ae7f5e-26ab-4084-a2c4-57f905446935', '96f35005-ec56-4f99-8c85-4ce0a3266c13', '9539910e-8959-4a96-9993-b0099a1c40b7', '15c0c74a-a25d-43b3-ac4c-18f357417687'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:18:02 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f11bdf41-dd17-4608-bf74-31e8086e28e4 tempest-VolumesGetTest-1307359977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.172s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:02 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-f11bdf41-dd17-4608-bf74-31e8086e28e4 tempest-VolumesGetTest-1307359977 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:18:02 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-f11bdf41-dd17-4608-bf74-31e8086e28e4 tempest-VolumesGetTest-1307359977 None] Deleted volume successfully. Jun 29 11:18:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c67ebe78-3abc-4f53-b8e8-3907fc9a7f5f tempest-VolumesTransfersV357Test-127274399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:18:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c67ebe78-3abc-4f53-b8e8-3907fc9a7f5f tempest-VolumesTransfersV357Test-127274399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:18:02 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c67ebe78-3abc-4f53-b8e8-3907fc9a7f5f tempest-VolumesTransfersV357Test-127274399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:18:02 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c67ebe78-3abc-4f53-b8e8-3907fc9a7f5f tempest-VolumesTransfersV357Test-127274399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:18:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c67ebe78-3abc-4f53-b8e8-3907fc9a7f5f tempest-VolumesTransfersV357Test-127274399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:18:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c67ebe78-3abc-4f53-b8e8-3907fc9a7f5f tempest-VolumesTransfersV357Test-127274399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:02 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f11bdf41-dd17-4608-bf74-31e8086e28e4 tempest-VolumesGetTest-1307359977 None] Lock "cinder-015929b2-815e-4b92-8f52-5f0ba630c402-delete_volume" released by "delete_volume" :: held 4.010s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:18:02 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:18:02 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:02 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ebadd485-625a-492f-ae14-9fd562d128a7 tempest-VolumesTestJSON-705776172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-26235da4-ae08-4247-9464-ba2609c20bae" returned: 0 in 1.244s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ebadd485-625a-492f-ae14-9fd562d128a7 tempest-VolumesTestJSON-705776172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-26235da4-ae08-4247-9464-ba2609c20bae {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:02 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-26235da4-ae08-4247-9464-ba2609c20bae Jun 29 11:18:02 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c67ebe78-3abc-4f53-b8e8-3907fc9a7f5f tempest-VolumesTransfersV357Test-127274399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.824s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:03 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-c67ebe78-3abc-4f53-b8e8-3907fc9a7f5f tempest-VolumesTransfersV357Test-127274399 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:18:03 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:03 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-c67ebe78-3abc-4f53-b8e8-3907fc9a7f5f tempest-VolumesTransfersV357Test-127274399 None] Deleted volume successfully. Jun 29 11:18:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c67ebe78-3abc-4f53-b8e8-3907fc9a7f5f tempest-VolumesTransfersV357Test-127274399 None] Lock "cinder-59b93e9d-1eb8-4a76-9cae-09ca5922eb88-delete_volume" released by "delete_volume" :: held 3.320s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:18:03 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ebadd485-625a-492f-ae14-9fd562d128a7 tempest-VolumesTestJSON-705776172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-26235da4-ae08-4247-9464-ba2609c20bae" returned: 0 in 0.797s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ebadd485-625a-492f-ae14-9fd562d128a7 tempest-VolumesTestJSON-705776172 None] Lock "cinder-quobyte-26235da4-ae08-4247-9464-ba2609c20bae" released by "delete_volume" :: held 2.111s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:18:03 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-ebadd485-625a-492f-ae14-9fd562d128a7 tempest-VolumesTestJSON-705776172 None] Created reservations ['46caef06-ce0c-453f-a932-65476f3ac121', '00832ab9-c40b-45a0-b291-17e98f4291d6', '0cab9d4b-2b47-454e-8f6a-7b7fd6100bc5', 'ff6e75c0-cad6-4e0f-9d7c-8ff3f63f63ad'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:18:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ebadd485-625a-492f-ae14-9fd562d128a7 tempest-VolumesTestJSON-705776172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:18:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ebadd485-625a-492f-ae14-9fd562d128a7 tempest-VolumesTestJSON-705776172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:18:03 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ebadd485-625a-492f-ae14-9fd562d128a7 tempest-VolumesTestJSON-705776172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:18:03 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ebadd485-625a-492f-ae14-9fd562d128a7 tempest-VolumesTestJSON-705776172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:18:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ebadd485-625a-492f-ae14-9fd562d128a7 tempest-VolumesTestJSON-705776172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:18:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ebadd485-625a-492f-ae14-9fd562d128a7 tempest-VolumesTestJSON-705776172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:03 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:18:03 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:04 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ebadd485-625a-492f-ae14-9fd562d128a7 tempest-VolumesTestJSON-705776172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.695s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:04 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-ebadd485-625a-492f-ae14-9fd562d128a7 tempest-VolumesTestJSON-705776172 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:18:04 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-ebadd485-625a-492f-ae14-9fd562d128a7 tempest-VolumesTestJSON-705776172 None] Deleted volume successfully. Jun 29 11:18:04 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ebadd485-625a-492f-ae14-9fd562d128a7 tempest-VolumesTestJSON-705776172 None] Lock "cinder-26235da4-ae08-4247-9464-ba2609c20bae-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:18:05 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-dcbb079b-f575-4814-bd45-206907d42ac7 tempest-VolumesTestJSON-705776172 None] Acquiring lock "cinder-3c6a11b7-8a2a-4be2-a051-81628147e10d-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:18:05 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-dcbb079b-f575-4814-bd45-206907d42ac7 tempest-VolumesTestJSON-705776172 None] Lock "cinder-3c6a11b7-8a2a-4be2-a051-81628147e10d-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:18:05 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-dcbb079b-f575-4814-bd45-206907d42ac7 tempest-VolumesTestJSON-705776172 None] Acquiring lock "cinder-quobyte-3c6a11b7-8a2a-4be2-a051-81628147e10d" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:18:05 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-dcbb079b-f575-4814-bd45-206907d42ac7 tempest-VolumesTestJSON-705776172 None] Lock "cinder-quobyte-3c6a11b7-8a2a-4be2-a051-81628147e10d" acquired by "delete_volume" :: waited 0.034s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:18:05 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eba8c02-a21b-4fda-ace6-e152292cc272]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:18:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dcbb079b-f575-4814-bd45-206907d42ac7 tempest-VolumesTestJSON-705776172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-3c6a11b7-8a2a-4be2-a051-81628147e10d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:05 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-3c6a11b7-8a2a-4be2-a051-81628147e10d Jun 29 11:18:05 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dcbb079b-f575-4814-bd45-206907d42ac7 tempest-VolumesTestJSON-705776172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-3c6a11b7-8a2a-4be2-a051-81628147e10d" returned: 0 in 1.185s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:06 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dcbb079b-f575-4814-bd45-206907d42ac7 tempest-VolumesTestJSON-705776172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-3c6a11b7-8a2a-4be2-a051-81628147e10d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:06 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-3c6a11b7-8a2a-4be2-a051-81628147e10d Jun 29 11:18:06 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:07 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dcbb079b-f575-4814-bd45-206907d42ac7 tempest-VolumesTestJSON-705776172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-3c6a11b7-8a2a-4be2-a051-81628147e10d" returned: 0 in 1.370s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:07 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-dcbb079b-f575-4814-bd45-206907d42ac7 tempest-VolumesTestJSON-705776172 None] Lock "cinder-quobyte-3c6a11b7-8a2a-4be2-a051-81628147e10d" released by "delete_volume" :: held 2.637s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:18:07 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-dcbb079b-f575-4814-bd45-206907d42ac7 tempest-VolumesTestJSON-705776172 None] Created reservations ['93f92e9d-f258-4a09-93f1-ec31c7c6fc99', 'c88b8716-bf34-47f9-aaac-d793361c7af8', '99ca7a23-bd8c-4bab-98e6-4a5f618ed735', 'ab8e7af5-cf90-4719-9fd6-b0b63189484e'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:18:08 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:18:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:18:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:18:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:18:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:18:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:18:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-dcbb079b-f575-4814-bd45-206907d42ac7 tempest-VolumesTestJSON-705776172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:18:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-dcbb079b-f575-4814-bd45-206907d42ac7 tempest-VolumesTestJSON-705776172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:18:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-dcbb079b-f575-4814-bd45-206907d42ac7 tempest-VolumesTestJSON-705776172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:18:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-dcbb079b-f575-4814-bd45-206907d42ac7 tempest-VolumesTestJSON-705776172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:18:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-dcbb079b-f575-4814-bd45-206907d42ac7 tempest-VolumesTestJSON-705776172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:18:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dcbb079b-f575-4814-bd45-206907d42ac7 tempest-VolumesTestJSON-705776172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:08 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:18:08 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:08 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:18:08 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:09 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dcbb079b-f575-4814-bd45-206907d42ac7 tempest-VolumesTestJSON-705776172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.332s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:09 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-dcbb079b-f575-4814-bd45-206907d42ac7 tempest-VolumesTestJSON-705776172 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:18:09 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-dcbb079b-f575-4814-bd45-206907d42ac7 tempest-VolumesTestJSON-705776172 None] Deleted volume successfully. Jun 29 11:18:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-dcbb079b-f575-4814-bd45-206907d42ac7 tempest-VolumesTestJSON-705776172 None] Lock "cinder-3c6a11b7-8a2a-4be2-a051-81628147e10d-delete_volume" released by "delete_volume" :: held 4.475s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:18:09 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.571s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:09 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:18:09 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager._thread_info {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:18:09 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread count: 29 {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 11:18:09 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread info: [<_MainThread(MainThread, started 131117520400512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 11:18:16 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:UPDATE=158,cinder:SELECT=120,cinder:DELETE=12,cinder:INSERT=38 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:18:16 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=105,cinder:UPDATE=149,cinder:INSERT=45,cinder:DELETE=15 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:18:16 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:18:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] Flow 'volume_create_manager' (d3dd46bc-7d8e-4d5a-80ce-93ec0f61c2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:18:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59afba17-f872-4331-87d3-ce7b854dd18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:18:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59afba17-f872-4331-87d3-ce7b854dd18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-860667030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7f3786c-2616-4f83-a2c7-26800f009315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a52958f43804405918e1b9f17c0a85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:18:16Z,use_quota=True,user_id='3c43ea4099ac4936869a005dd1db5c5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:18:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (080f8efb-4e05-4b69-bd95-ccba38deccda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:18:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (080f8efb-4e05-4b69-bd95-ccba38deccda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:18:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c965ec91-28b8-42b6-97e5-1039b081f45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:18:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c965ec91-28b8-42b6-97e5-1039b081f45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7f3786c-2616-4f83-a2c7-26800f009315', 'volume_name': 'volume-f7f3786c-2616-4f83-a2c7-26800f009315', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:18:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d7e61a-f276-4687-8b15-18dcab9c7ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:18:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d7e61a-f276-4687-8b15-18dcab9c7ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:18:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2716dca6-bc37-4c78-bafb-a879e5bd29fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:18:16 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] Volume f7f3786c-2616-4f83-a2c7-26800f009315: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7f3786c-2616-4f83-a2c7-26800f009315', 'volume_size': 1} Jun 29 11:18:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:18:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:18:16 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-860667030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7f3786c-2616-4f83-a2c7-26800f009315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a52958f43804405918e1b9f17c0a85a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:18:16Z,use_quota=True,user_id='3c43ea4099ac4936869a005dd1db5c5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:18:16 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] Creating volume f7f3786c-2616-4f83-a2c7-26800f009315 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:18:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:18:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:18:16 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:18:16 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:18:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:18:16 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:18:16 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:18:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f7f3786c-2616-4f83-a2c7-26800f009315 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:16 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f7f3786c-2616-4f83-a2c7-26800f009315 1073741824 Jun 29 11:18:16 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:17 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f7f3786c-2616-4f83-a2c7-26800f009315 1073741824" returned: 0 in 1.380s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f7f3786c-2616-4f83-a2c7-26800f009315 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:17 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f7f3786c-2616-4f83-a2c7-26800f009315 Jun 29 11:18:17 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:18 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f7f3786c-2616-4f83-a2c7-26800f009315" returned: 0 in 0.929s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:18 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] <== create_volume: return (2375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:18:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.378s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:18:18 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2716dca6-bc37-4c78-bafb-a879e5bd29fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7f3786c-2616-4f83-a2c7-26800f009315', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:18:18 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a3a9343-3b69-4d6d-ba7a-c4ae66d9b0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:18:18 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] Volume volume-f7f3786c-2616-4f83-a2c7-26800f009315 (f7f3786c-2616-4f83-a2c7-26800f009315): created successfully Jun 29 11:18:18 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a3a9343-3b69-4d6d-ba7a-c4ae66d9b0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:18:18 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] Flow 'volume_create_manager' (d3dd46bc-7d8e-4d5a-80ce-93ec0f61c2e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:18:18 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-47cad485-ea63-472e-84a7-c658e3b6fccc tempest-VolumesNegativeTest-1175074396 None] Created volume successfully. Jun 29 11:18:21 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-631f2cd8-2046-4249-a6e6-5ca8ecdede61 tempest-GroupsV314Test-1818508283 None] Group tempest-GroupsV314Test-Group-1895984868: creating Jun 29 11:18:21 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-631f2cd8-2046-4249-a6e6-5ca8ecdede61 tempest-GroupsV314Test-1818508283 None] Group tempest-GroupsV314Test-Group-1895984868: created successfully Jun 29 11:18:21 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-631f2cd8-2046-4249-a6e6-5ca8ecdede61 tempest-GroupsV314Test-1818508283 None] Create group completed successfully. Jun 29 11:18:23 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:18:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] Flow 'volume_create_manager' (1187f90b-88f3-4258-a0fd-5720baa7713c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:18:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7221b5cb-f831-41fa-924a-5af0654e8cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:18:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7221b5cb-f831-41fa-924a-5af0654e8cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1212241987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=07a4367e-709f-4734-9950-d793969cf46a,host='devstack@QuobyteHD#QuobyteHD',id=8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1b9d09d2b04091a88dbef7f7cbe115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:18:23Z,use_quota=True,user_id='6290848ba2384185a08fb5404c85a825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7926864-16f3-4692-a9da-d53717ad8842),volume_type_id=e7926864-16f3-4692-a9da-d53717ad8842)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:18:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4127ed92-a079-4509-9822-41b6bed4f0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:18:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4127ed92-a079-4509-9822-41b6bed4f0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:18:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dd41727-bc90-4c4a-b9e2-3899db127352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:18:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dd41727-bc90-4c4a-b9e2-3899db127352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2', 'volume_name': 'volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:18:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ca70fe7-6e77-483f-88c0-2ce7edfeceb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:18:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ca70fe7-6e77-483f-88c0-2ce7edfeceb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:18:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a95948b1-162f-4f0a-939a-a66a80bba7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:18:23 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] Volume 8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2', 'volume_size': 1} Jun 29 11:18:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:18:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:18:23 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=07a4367e-709f-4734-9950-d793969cf46a,created_at=2026-06-29T09:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1212241987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=07a4367e-709f-4734-9950-d793969cf46a,host='devstack@QuobyteHD#QuobyteHD',id=8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1b9d09d2b04091a88dbef7f7cbe115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:18:23Z,use_quota=True,user_id='6290848ba2384185a08fb5404c85a825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7926864-16f3-4692-a9da-d53717ad8842),volume_type_id=e7926864-16f3-4692-a9da-d53717ad8842)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:18:23 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] Creating volume 8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:18:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:18:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:18:23 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:18:23 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:18:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:18:23 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:18:23 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:18:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:23 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2 1073741824 Jun 29 11:18:23 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:24 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2 1073741824" returned: 0 in 0.889s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:24 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2 Jun 29 11:18:24 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:24 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2" returned: 0 in 0.705s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:24 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:18:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:18:24 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a95948b1-162f-4f0a-939a-a66a80bba7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:18:24 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e146924-b706-4974-8345-bafc786b41a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:18:24 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] Volume volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2 (8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2): created successfully Jun 29 11:18:24 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e146924-b706-4974-8345-bafc786b41a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:18:24 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] Flow 'volume_create_manager' (1187f90b-88f3-4258-a0fd-5720baa7713c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:18:24 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-c9d23ebc-51b2-4a45-a11c-e39d17482bea tempest-GroupsV314Test-1818508283 None] Created volume successfully. Jun 29 11:18:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:18:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:18:26 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Cloning volume 8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2 to volume d8c5ba22-c5e2-46f6-ae1f-800104bbc315 Jun 29 11:18:26 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Creating offline snapshot 494e978c-c24d-4056-a85a-379c1baa8a50 of volume 8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2 {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:18:26 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3840ffe7-bb19-402b-85cd-88847e6d0588]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:18:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:26 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2 Jun 29 11:18:26 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:27 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2" returned: 0 in 1.055s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2.494e978c-c24d-4056-a85a-379c1baa8a50 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:27 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2.494e978c-c24d-4056-a85a-379c1baa8a50 1G Jun 29 11:18:27 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:29 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2.494e978c-c24d-4056-a85a-379c1baa8a50 1G" returned: 0 in 1.207s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2.494e978c-c24d-4056-a85a-379c1baa8a50 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:29 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2.494e978c-c24d-4056-a85a-379c1baa8a50 Jun 29 11:18:29 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:29 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2.494e978c-c24d-4056-a85a-379c1baa8a50" returned: 0 in 0.935s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:29 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2.494e978c-c24d-4056-a85a-379c1baa8a50 is being set with open permissions: ugo+rw: NotImplementedError Jun 29 11:18:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2.494e978c-c24d-4056-a85a-379c1baa8a50 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:30 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2.494e978c-c24d-4056-a85a-379c1baa8a50 Jun 29 11:18:30 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:30 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2.494e978c-c24d-4056-a85a-379c1baa8a50" returned: 0 in 0.756s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:30 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2.info Jun 29 11:18:30 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:31 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2.info" returned: 0 in 0.997s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:31 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2.info is being set with open permissions: ugo+rw: NotImplementedError Jun 29 11:18:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:31 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2.info Jun 29 11:18:31 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:32 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2.info" returned: 0 in 0.749s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:32 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Acquiring lock "cinder-quobyte-d8c5ba22-c5e2-46f6-ae1f-800104bbc315" by "_copy_volume_from_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:18:32 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Lock "cinder-quobyte-d8c5ba22-c5e2-46f6-ae1f-800104bbc315" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:18:32 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] snapshot: 494e978c-c24d-4056-a85a-379c1baa8a50, volume: d8c5ba22-c5e2-46f6-ae1f-800104bbc315, {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 11:18:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:18:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:18:32 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:18:32 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:18:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:18:32 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[133b151b-8256-431a-868b-10bfb809375a]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:18:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2.494e978c-c24d-4056-a85a-379c1baa8a50 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:32 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2.494e978c-c24d-4056-a85a-379c1baa8a50 Jun 29 11:18:32 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:33 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2.494e978c-c24d-4056-a85a-379c1baa8a50" returned: 0 in 0.903s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:33 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:18:33 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2 {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 11:18:33 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Creating direct copy from snapshot {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 11:18:33 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6216c1-6693-4ece-957e-d16451477aea]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:18:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:33 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2 Jun 29 11:18:33 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:34 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2" returned: 0 in 1.058s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:34 devstack cinder-volume[93497]: DEBUG cinder.utils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Path /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d8c5ba22-c5e2-46f6-ae1f-800104bbc315 not found in is_blk_device check {{(pid=93497) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 11:18:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d8c5ba22-c5e2-46f6-ae1f-800104bbc315 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:34 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d8c5ba22-c5e2-46f6-ae1f-800104bbc315 Jun 29 11:18:34 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:40 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:UPDATE=8,cinder:SELECT=11,cinder:DELETE=1,cinder:INSERT=1 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:18:40 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=10,cinder:INSERT=3,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:18:41 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-e069a3a4-9161-4141-8dda-601077092780 req-f9098f89-86b2-4412-81c3-d7bb1b8e621b tempest-TestMinimumBasicScenario-191147528 None] Terminate volume connection completed successfully. Jun 29 11:18:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-e069a3a4-9161-4141-8dda-601077092780 req-f9098f89-86b2-4412-81c3-d7bb1b8e621b tempest-TestMinimumBasicScenario-191147528 None] Deleting attachment 76af970b-a256-4f5f-b23d-8b7e53598b78. {{(pid=93497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 11:18:41 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d8c5ba22-c5e2-46f6-ae1f-800104bbc315" returned: 0 in 7.314s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:41 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c467c886-2431-4ea7-bc04-b309c088b4a9]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:18:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:42 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2 Jun 29 11:18:42 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:43 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:18:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Flow 'volume_create_manager' (bc6b87d3-e111-4eea-94ed-07e16ebfd473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:18:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24731f33-cea6-483f-9ee8-15fb84f21090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:18:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24731f33-cea6-483f-9ee8-15fb84f21090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2080956765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f24ac8fe-816f-4914-b1b7-ca6c2d303819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b3abf0ee994fdea89b4b00dfb744f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:18:43Z,use_quota=True,user_id='37ff8100472d4b30be3d88fe1b47a779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:18:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef4976eb-a832-4d50-ac80-25383fd6c5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:18:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef4976eb-a832-4d50-ac80-25383fd6c5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:18:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a32519-8264-47ff-9713-828cb667a5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:18:43 devstack cinder-volume[93497]: DEBUG cinder.image.glance [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Creating Keystone auth plugin from conf {{(pid=93497) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 29 11:18:43 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e70c04c5-b5f0-4a49-85d8-47f2d244973b tempest-TestMinimumBasicScenario-191147528 None] Acquiring lock "cinder-73ccad64-0e68-47d3-b1c4-d148b0096998-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:18:43 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e70c04c5-b5f0-4a49-85d8-47f2d244973b tempest-TestMinimumBasicScenario-191147528 None] Lock "cinder-73ccad64-0e68-47d3-b1c4-d148b0096998-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:18:43 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e70c04c5-b5f0-4a49-85d8-47f2d244973b tempest-TestMinimumBasicScenario-191147528 None] Acquiring lock "cinder-quobyte-73ccad64-0e68-47d3-b1c4-d148b0096998" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:18:43 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e70c04c5-b5f0-4a49-85d8-47f2d244973b tempest-TestMinimumBasicScenario-191147528 None] Lock "cinder-quobyte-73ccad64-0e68-47d3-b1c4-d148b0096998" acquired by "delete_volume" :: waited 0.037s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:18:43 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c13920-6436-44d3-806a-6358c90254e7]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:18:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e70c04c5-b5f0-4a49-85d8-47f2d244973b tempest-TestMinimumBasicScenario-191147528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-73ccad64-0e68-47d3-b1c4-d148b0096998 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:43 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2" returned: 0 in 1.759s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:43 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Image conversion details: src /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2, size 1024.00 MB, duration 7.32 sec, destination /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d8c5ba22-c5e2-46f6-ae1f-800104bbc315 {{(pid=93497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 11:18:43 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Converted 1024.00 MB image at 139.96 MB/s Jun 29 11:18:43 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d8c5ba22-c5e2-46f6-ae1f-800104bbc315 is being set with open permissions: ugo+rw: NotImplementedError Jun 29 11:18:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d8c5ba22-c5e2-46f6-ae1f-800104bbc315 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:43 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d8c5ba22-c5e2-46f6-ae1f-800104bbc315 Jun 29 11:18:43 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:43 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-73ccad64-0e68-47d3-b1c4-d148b0096998 Jun 29 11:18:43 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a32519-8264-47ff-9713-828cb667a5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f24ac8fe-816f-4914-b1b7-ca6c2d303819', 'volume_name': 'volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819', 'volume_size': 1, 'image_id': 'e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '376ed9c5d02d4ab0be650a3f1fd75615', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'created_at': datetime.datetime(2026, 6, 29, 8, 56, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 8, 56, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:18:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d2ddb49-0d3b-498c-954d-883e944d6a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:18:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d2ddb49-0d3b-498c-954d-883e944d6a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:18:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c6d87f0-3c1d-41ca-981b-a89d45b810a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:18:44 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Volume f24ac8fe-816f-4914-b1b7-ca6c2d303819: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819', 'volume_size': 1, 'image_id': 'e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '376ed9c5d02d4ab0be650a3f1fd75615', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'created_at': datetime.datetime(2026, 6, 29, 8, 56, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 8, 56, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 29 11:18:44 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Trying to clone f24ac8fe-816f-4914-b1b7-ca6c2d303819 from image e2b32301-75fb-4235-bdc7-d391d7ce88e1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'metadata': {}}]). {{(pid=93497) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 29 11:18:44 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_to7f8xb0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93497) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 29 11:18:44 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Image download 20.69 MB at 20.69 MB/s Jun 29 11:18:44 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2c6873-5bfc-48c9-b192-d9364eda0589]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:18:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_to7f8xb0devstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:44 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_to7f8xb0devstack@QuobyteHD Jun 29 11:18:44 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:44 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d8c5ba22-c5e2-46f6-ae1f-800104bbc315" returned: 0 in 1.221s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:45 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Lock "cinder-quobyte-d8c5ba22-c5e2-46f6-ae1f-800104bbc315" released by "_copy_volume_from_snapshot" :: held 12.423s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:18:45 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Acquiring lock "cinder-quobyte-494e978c-c24d-4056-a85a-379c1baa8a50" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:18:45 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Lock "cinder-quobyte-494e978c-c24d-4056-a85a-379c1baa8a50" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:18:45 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Deleting offline snapshot 494e978c-c24d-4056-a85a-379c1baa8a50 of volume 8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:18:45 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] snapshot_file for this snap is: volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2.494e978c-c24d-4056-a85a-379c1baa8a50 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:18:45 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9b8776-6fce-43c0-a8e1-2e86fb1fdc4e]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:18:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2.494e978c-c24d-4056-a85a-379c1baa8a50 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:45 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2.494e978c-c24d-4056-a85a-379c1baa8a50 Jun 29 11:18:45 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:45 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e70c04c5-b5f0-4a49-85d8-47f2d244973b tempest-TestMinimumBasicScenario-191147528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-73ccad64-0e68-47d3-b1c4-d148b0096998" returned: 0 in 1.585s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e70c04c5-b5f0-4a49-85d8-47f2d244973b tempest-TestMinimumBasicScenario-191147528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-73ccad64-0e68-47d3-b1c4-d148b0096998 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:45 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-73ccad64-0e68-47d3-b1c4-d148b0096998 Jun 29 11:18:45 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:46 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_to7f8xb0devstack@QuobyteHD" returned: 0 in 1.455s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:46 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Temporary image e2b32301-75fb-4235-bdc7-d391d7ce88e1 is fetched for user 37ff8100472d4b30be3d88fe1b47a779. {{(pid=93497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 29 11:18:46 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d278b341-b289-456c-8f43-be094b4de0fd]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:18:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_to7f8xb0devstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:46 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e70c04c5-b5f0-4a49-85d8-47f2d244973b tempest-TestMinimumBasicScenario-191147528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-73ccad64-0e68-47d3-b1c4-d148b0096998" returned: 0 in 0.979s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:46 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e70c04c5-b5f0-4a49-85d8-47f2d244973b tempest-TestMinimumBasicScenario-191147528 None] Lock "cinder-quobyte-73ccad64-0e68-47d3-b1c4-d148b0096998" released by "delete_volume" :: held 2.647s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:18:46 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:46 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_to7f8xb0devstack@QuobyteHD Jun 29 11:18:46 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2.494e978c-c24d-4056-a85a-379c1baa8a50" returned: 0 in 1.230s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:18:46 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35aea88-fd98-47da-a2c2-acabe7316246]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:18:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:46 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-e70c04c5-b5f0-4a49-85d8-47f2d244973b tempest-TestMinimumBasicScenario-191147528 None] Created reservations ['7c992586-6e98-40cf-96dc-b91ad815a798', 'a8d9ce47-1680-4f35-9c4f-fcd223f9d029', '45808b32-7c2e-4e40-a2e3-7b03d748770c', '2c25e9e2-e2ba-460e-affc-90b2c4527a27'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:18:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e70c04c5-b5f0-4a49-85d8-47f2d244973b tempest-TestMinimumBasicScenario-191147528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:18:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e70c04c5-b5f0-4a49-85d8-47f2d244973b tempest-TestMinimumBasicScenario-191147528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:18:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-e70c04c5-b5f0-4a49-85d8-47f2d244973b tempest-TestMinimumBasicScenario-191147528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:18:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-e70c04c5-b5f0-4a49-85d8-47f2d244973b tempest-TestMinimumBasicScenario-191147528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:18:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e70c04c5-b5f0-4a49-85d8-47f2d244973b tempest-TestMinimumBasicScenario-191147528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:18:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e70c04c5-b5f0-4a49-85d8-47f2d244973b tempest-TestMinimumBasicScenario-191147528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:46 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2 Jun 29 11:18:46 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:46 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:18:46 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:47 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_to7f8xb0devstack@QuobyteHD" returned: 0 in 1.184s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:18:47 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2" returned: 0 in 1.169s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2.494e978c-c24d-4056-a85a-379c1baa8a50 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:47 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2.494e978c-c24d-4056-a85a-379c1baa8a50 Jun 29 11:18:47 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:47 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e70c04c5-b5f0-4a49-85d8-47f2d244973b tempest-TestMinimumBasicScenario-191147528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.184s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:47 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-e70c04c5-b5f0-4a49-85d8-47f2d244973b tempest-TestMinimumBasicScenario-191147528 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:18:47 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-e70c04c5-b5f0-4a49-85d8-47f2d244973b tempest-TestMinimumBasicScenario-191147528 None] Deleted volume successfully. Jun 29 11:18:47 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e70c04c5-b5f0-4a49-85d8-47f2d244973b tempest-TestMinimumBasicScenario-191147528 None] Lock "cinder-73ccad64-0e68-47d3-b1c4-d148b0096998-delete_volume" released by "delete_volume" :: held 4.309s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:18:48 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2.494e978c-c24d-4056-a85a-379c1baa8a50" returned: 0 in 0.886s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2.494e978c-c24d-4056-a85a-379c1baa8a50 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:48 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2.494e978c-c24d-4056-a85a-379c1baa8a50 Jun 29 11:18:48 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:49 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2.494e978c-c24d-4056-a85a-379c1baa8a50" returned: 0 in 0.886s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:49 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Lock "cinder-quobyte-494e978c-c24d-4056-a85a-379c1baa8a50" released by "_delete_snapshot" :: held 4.313s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:18:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.678s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:18:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.029s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:18:49 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2080956765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f24ac8fe-816f-4914-b1b7-ca6c2d303819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b3abf0ee994fdea89b4b00dfb744f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:18:43Z,use_quota=True,user_id='37ff8100472d4b30be3d88fe1b47a779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:18:49 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Creating volume f24ac8fe-816f-4914-b1b7-ca6c2d303819 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:18:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:18:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:18:49 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:18:49 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:18:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:18:49 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:18:49 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:18:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:49 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819 1073741824 Jun 29 11:18:49 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:49 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-d851ba0f-ba99-49f9-b896-0e41a00f3745 tempest-GroupsV314Test-1818508283 None] Create group from source-group-07a4367e-709f-4734-9950-d793969cf46a completed successfully. Jun 29 11:18:50 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819 1073741824" returned: 0 in 1.043s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:50 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819 Jun 29 11:18:50 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:50 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-5fe53408-9025-467a-a05b-682376f37511 tempest-GroupsV314Test-1818508283 None] Acquiring lock "cinder-quobyte-d8c5ba22-c5e2-46f6-ae1f-800104bbc315" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:18:50 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-5fe53408-9025-467a-a05b-682376f37511 tempest-GroupsV314Test-1818508283 None] Lock "cinder-quobyte-d8c5ba22-c5e2-46f6-ae1f-800104bbc315" acquired by "delete_volume" :: waited 0.015s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:18:50 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4e5b96-4eb4-4f68-b898-5974e8af5152]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:18:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fe53408-9025-467a-a05b-682376f37511 tempest-GroupsV314Test-1818508283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d8c5ba22-c5e2-46f6-ae1f-800104bbc315 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:50 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d8c5ba22-c5e2-46f6-ae1f-800104bbc315 Jun 29 11:18:50 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:51 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819" returned: 0 in 0.738s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:18:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.848s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:18:51 devstack cinder-volume[93497]: DEBUG cinder.volume.volume_utils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Attempting download of e2b32301-75fb-4235-bdc7-d391d7ce88e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'metadata': {}}])) to volume f24ac8fe-816f-4914-b1b7-ca6c2d303819. {{(pid=93497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 29 11:18:51 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee0f495-f186-4779-abce-93ee899c8fee]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:18:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2b32301-75fb-4235-bdc7-d391d7ce88e1_w040ia_9 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:51 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2b32301-75fb-4235-bdc7-d391d7ce88e1_w040ia_9 Jun 29 11:18:51 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:51 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fe53408-9025-467a-a05b-682376f37511 tempest-GroupsV314Test-1818508283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d8c5ba22-c5e2-46f6-ae1f-800104bbc315" returned: 0 in 0.840s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fe53408-9025-467a-a05b-682376f37511 tempest-GroupsV314Test-1818508283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d8c5ba22-c5e2-46f6-ae1f-800104bbc315 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:51 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d8c5ba22-c5e2-46f6-ae1f-800104bbc315 Jun 29 11:18:51 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:52 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2b32301-75fb-4235-bdc7-d391d7ce88e1_w040ia_9" returned: 0 in 0.787s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2b32301-75fb-4235-bdc7-d391d7ce88e1_w040ia_9 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:52 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2b32301-75fb-4235-bdc7-d391d7ce88e1_w040ia_9 Jun 29 11:18:52 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:52 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fe53408-9025-467a-a05b-682376f37511 tempest-GroupsV314Test-1818508283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d8c5ba22-c5e2-46f6-ae1f-800104bbc315" returned: 0 in 0.657s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:52 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-5fe53408-9025-467a-a05b-682376f37511 tempest-GroupsV314Test-1818508283 None] Lock "cinder-quobyte-d8c5ba22-c5e2-46f6-ae1f-800104bbc315" released by "delete_volume" :: held 1.549s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:18:52 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-5fe53408-9025-467a-a05b-682376f37511 tempest-GroupsV314Test-1818508283 None] Created reservations ['e26721e4-7a1e-43a9-ac0c-a00b7db554cc'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:18:52 devstack cinder-volume[93497]: WARNING cinder.quota [None req-5fe53408-9025-467a-a05b-682376f37511 tempest-GroupsV314Test-1818508283 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-292502451 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-292502451, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:18:52 devstack cinder-volume[93497]: WARNING cinder.quota [None req-5fe53408-9025-467a-a05b-682376f37511 tempest-GroupsV314Test-1818508283 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-292502451 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-292502451, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:18:52 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-5fe53408-9025-467a-a05b-682376f37511 tempest-GroupsV314Test-1818508283 None] Created reservations ['e32219c9-a484-4be7-9c82-c98821e3c427', '437eaa4b-829f-4aa8-9fa5-bdeb3e0322fb', '599607b5-ffae-4d12-ac93-7b99e5996b8a', '8aeb6184-f8d3-4427-883e-36f81f3400d3'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:18:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5fe53408-9025-467a-a05b-682376f37511 tempest-GroupsV314Test-1818508283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:18:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5fe53408-9025-467a-a05b-682376f37511 tempest-GroupsV314Test-1818508283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:18:52 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5fe53408-9025-467a-a05b-682376f37511 tempest-GroupsV314Test-1818508283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:18:52 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5fe53408-9025-467a-a05b-682376f37511 tempest-GroupsV314Test-1818508283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:18:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5fe53408-9025-467a-a05b-682376f37511 tempest-GroupsV314Test-1818508283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:18:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fe53408-9025-467a-a05b-682376f37511 tempest-GroupsV314Test-1818508283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:52 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:18:52 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:52 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2b32301-75fb-4235-bdc7-d391d7ce88e1_w040ia_9" returned: 1 in 0.829s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2b32301-75fb-4235-bdc7-d391d7ce88e1_w040ia_9' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:18:52 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf33015-af24-43fa-a7f2-e8011a34210e]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:18:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_to7f8xb0devstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:53 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_to7f8xb0devstack@QuobyteHD Jun 29 11:18:53 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:53 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fe53408-9025-467a-a05b-682376f37511 tempest-GroupsV314Test-1818508283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.695s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:53 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-5fe53408-9025-467a-a05b-682376f37511 tempest-GroupsV314Test-1818508283 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:18:53 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-5fe53408-9025-467a-a05b-682376f37511 tempest-GroupsV314Test-1818508283 None] Delete group completed successfully. Jun 29 11:18:53 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-007af081-b15d-4786-9204-9588d696e262 tempest-GroupsV314Test-1818508283 None] Acquiring lock "cinder-quobyte-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:18:53 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-007af081-b15d-4786-9204-9588d696e262 tempest-GroupsV314Test-1818508283 None] Lock "cinder-quobyte-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2" acquired by "delete_volume" :: waited 0.017s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:18:53 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a638010-d9e9-483a-8a1a-dcac8ea18fd7]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:18:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-007af081-b15d-4786-9204-9588d696e262 tempest-GroupsV314Test-1818508283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:53 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2 Jun 29 11:18:53 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:53 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_to7f8xb0devstack@QuobyteHD" returned: 0 in 0.807s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:53 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] e2b32301-75fb-4235-bdc7-d391d7ce88e1 was qcow2, converting to raw {{(pid=93497) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 29 11:18:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_to7f8xb0devstack@QuobyteHD /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:53 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_to7f8xb0devstack@QuobyteHD /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819 Jun 29 11:18:53 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:54 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-007af081-b15d-4786-9204-9588d696e262 tempest-GroupsV314Test-1818508283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2" returned: 0 in 0.847s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-007af081-b15d-4786-9204-9588d696e262 tempest-GroupsV314Test-1818508283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:54 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2 Jun 29 11:18:54 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:55 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-007af081-b15d-4786-9204-9588d696e262 tempest-GroupsV314Test-1818508283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2" returned: 0 in 0.795s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-007af081-b15d-4786-9204-9588d696e262 tempest-GroupsV314Test-1818508283 None] Lock "cinder-quobyte-8dc8cd5f-e679-4bd3-af64-cf39ad2da5d2" released by "delete_volume" :: held 1.705s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:18:55 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-007af081-b15d-4786-9204-9588d696e262 tempest-GroupsV314Test-1818508283 None] Created reservations ['b813280d-9ca2-4834-afe3-430a7967cc2e'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:18:55 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-007af081-b15d-4786-9204-9588d696e262 tempest-GroupsV314Test-1818508283 None] Created reservations ['4b6d6dd9-6222-4f90-929b-893710a21a88', 'e2071e00-837f-40cd-9226-71e0606a9ff1', 'a221a421-d084-44ca-88a9-3fb6785537bc', 'f59b4361-0369-47db-884c-384721db98b4'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:18:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-007af081-b15d-4786-9204-9588d696e262 tempest-GroupsV314Test-1818508283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:18:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-007af081-b15d-4786-9204-9588d696e262 tempest-GroupsV314Test-1818508283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:18:55 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-007af081-b15d-4786-9204-9588d696e262 tempest-GroupsV314Test-1818508283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:18:55 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-007af081-b15d-4786-9204-9588d696e262 tempest-GroupsV314Test-1818508283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:18:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-007af081-b15d-4786-9204-9588d696e262 tempest-GroupsV314Test-1818508283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:18:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-007af081-b15d-4786-9204-9588d696e262 tempest-GroupsV314Test-1818508283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:55 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:18:55 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:56 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_to7f8xb0devstack@QuobyteHD /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819" returned: 0 in 2.415s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:56 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_to7f8xb0devstack@QuobyteHD, size 112.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819 {{(pid=93497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 11:18:56 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Converted 112.00 MB image at 46.30 MB/s Jun 29 11:18:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:56 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819 1G Jun 29 11:18:56 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:56 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-007af081-b15d-4786-9204-9588d696e262 tempest-GroupsV314Test-1818508283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.908s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:56 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-007af081-b15d-4786-9204-9588d696e262 tempest-GroupsV314Test-1818508283 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:18:56 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-007af081-b15d-4786-9204-9588d696e262 tempest-GroupsV314Test-1818508283 None] Delete group completed successfully. Jun 29 11:18:57 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819 1G" returned: 0 in 1.014s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:57 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[38079fc3-c817-4723-a118-a55e6029bac4]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:18:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:57 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819 Jun 29 11:18:57 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:58 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819" returned: 0 in 1.015s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:18:58 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819 Jun 29 11:18:58 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:18:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819" returned: 1 in 1.099s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:18:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:18:59 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Jun 29 11:18:59 devstack cinder-volume[93497]: DEBUG cinder.volume.volume_utils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Downloaded image e2b32301-75fb-4235-bdc7-d391d7ce88e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'metadata': {}}])) to volume f24ac8fe-816f-4914-b1b7-ca6c2d303819 successfully. {{(pid=93497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 29 11:18:59 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Temporary image e2b32301-75fb-4235-bdc7-d391d7ce88e1 for user 37ff8100472d4b30be3d88fe1b47a779 is deleted. {{(pid=93497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 29 11:18:59 devstack cinder-volume[93497]: DEBUG cinder.volume.volume_utils [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Marking volume f24ac8fe-816f-4914-b1b7-ca6c2d303819 as bootable. {{(pid=93497) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 29 11:18:59 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Copying metadata from image e2b32301-75fb-4235-bdc7-d391d7ce88e1 to f24ac8fe-816f-4914-b1b7-ca6c2d303819. {{(pid=93497) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 29 11:18:59 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Creating volume glance metadata for volume f24ac8fe-816f-4914-b1b7-ca6c2d303819 backed by image e2b32301-75fb-4235-bdc7-d391d7ce88e1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93497) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 29 11:18:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c6d87f0-3c1d-41ca-981b-a89d45b810a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819', 'volume_size': 1, 'image_id': 'e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '376ed9c5d02d4ab0be650a3f1fd75615', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'created_at': datetime.datetime(2026, 6, 29, 8, 56, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 8, 56, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:18:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (018a482f-223a-409b-9f69-907cea7436bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:18:59 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Volume volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819 (f24ac8fe-816f-4914-b1b7-ca6c2d303819): created successfully Jun 29 11:18:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (018a482f-223a-409b-9f69-907cea7436bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:18:59 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Flow 'volume_create_manager' (bc6b87d3-e111-4eea-94ed-07e16ebfd473) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:18:59 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-a413b6c9-0aa3-4d36-94a4-38381bd50658 tempest-TestShelveInstance-569084186 None] Created volume successfully. Jun 29 11:19:02 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-6e3d57d8-0645-4eee-b245-dec0e3509613 tempest-VolumesNegativeTest-1175074396 None] Acquiring lock "cinder-f7f3786c-2616-4f83-a2c7-26800f009315-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:19:02 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-6e3d57d8-0645-4eee-b245-dec0e3509613 tempest-VolumesNegativeTest-1175074396 None] Lock "cinder-f7f3786c-2616-4f83-a2c7-26800f009315-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:19:02 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-6e3d57d8-0645-4eee-b245-dec0e3509613 tempest-VolumesNegativeTest-1175074396 None] Acquiring lock "cinder-quobyte-f7f3786c-2616-4f83-a2c7-26800f009315" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:19:02 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-6e3d57d8-0645-4eee-b245-dec0e3509613 tempest-VolumesNegativeTest-1175074396 None] Lock "cinder-quobyte-f7f3786c-2616-4f83-a2c7-26800f009315" acquired by "delete_volume" :: waited 0.020s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:19:02 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba3d4a5-a1ac-4d07-b599-93e46c62243d]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:19:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6e3d57d8-0645-4eee-b245-dec0e3509613 tempest-VolumesNegativeTest-1175074396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f7f3786c-2616-4f83-a2c7-26800f009315 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:02 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f7f3786c-2616-4f83-a2c7-26800f009315 Jun 29 11:19:02 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:02 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-59da0f5b-0ad9-4785-b401-e1661dc2d135 tempest-GroupsV320Test-1122834609 None] Group tempest-GroupsV320Test-Group-1236888973: creating Jun 29 11:19:02 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-59da0f5b-0ad9-4785-b401-e1661dc2d135 tempest-GroupsV320Test-1122834609 None] Group tempest-GroupsV320Test-Group-1236888973: created successfully Jun 29 11:19:02 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-59da0f5b-0ad9-4785-b401-e1661dc2d135 tempest-GroupsV320Test-1122834609 None] Create group completed successfully. Jun 29 11:19:03 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6e3d57d8-0645-4eee-b245-dec0e3509613 tempest-VolumesNegativeTest-1175074396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f7f3786c-2616-4f83-a2c7-26800f009315" returned: 0 in 0.944s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6e3d57d8-0645-4eee-b245-dec0e3509613 tempest-VolumesNegativeTest-1175074396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f7f3786c-2616-4f83-a2c7-26800f009315 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:03 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f7f3786c-2616-4f83-a2c7-26800f009315 Jun 29 11:19:03 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:03 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6e3d57d8-0645-4eee-b245-dec0e3509613 tempest-VolumesNegativeTest-1175074396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f7f3786c-2616-4f83-a2c7-26800f009315" returned: 0 in 0.651s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-6e3d57d8-0645-4eee-b245-dec0e3509613 tempest-VolumesNegativeTest-1175074396 None] Lock "cinder-quobyte-f7f3786c-2616-4f83-a2c7-26800f009315" released by "delete_volume" :: held 1.646s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:19:03 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-6e3d57d8-0645-4eee-b245-dec0e3509613 tempest-VolumesNegativeTest-1175074396 None] Created reservations ['2210593c-2083-4728-becb-c920ff1d1eab', 'e619d5f6-099e-4717-ad50-afbc53bda972', '54b9ab77-a27f-4e28-9aeb-87782867bbc8', 'f51872fd-2d87-4883-9582-eb89238069b4'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:19:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-6e3d57d8-0645-4eee-b245-dec0e3509613 tempest-VolumesNegativeTest-1175074396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:19:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-6e3d57d8-0645-4eee-b245-dec0e3509613 tempest-VolumesNegativeTest-1175074396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:19:04 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-6e3d57d8-0645-4eee-b245-dec0e3509613 tempest-VolumesNegativeTest-1175074396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:19:04 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-6e3d57d8-0645-4eee-b245-dec0e3509613 tempest-VolumesNegativeTest-1175074396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:19:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-6e3d57d8-0645-4eee-b245-dec0e3509613 tempest-VolumesNegativeTest-1175074396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:19:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6e3d57d8-0645-4eee-b245-dec0e3509613 tempest-VolumesNegativeTest-1175074396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:04 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:19:04 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:04 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-2bf60676-308d-4114-aff4-3042d0e16a4b tempest-GroupsV320Test-1122834609 None] Created reservations ['a2072d23-4b26-468b-8f99-48bf2e8b8013'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:19:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2bf60676-308d-4114-aff4-3042d0e16a4b tempest-GroupsV320Test-1122834609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:19:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2bf60676-308d-4114-aff4-3042d0e16a4b tempest-GroupsV320Test-1122834609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:19:04 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2bf60676-308d-4114-aff4-3042d0e16a4b tempest-GroupsV320Test-1122834609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:19:04 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2bf60676-308d-4114-aff4-3042d0e16a4b tempest-GroupsV320Test-1122834609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:19:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2bf60676-308d-4114-aff4-3042d0e16a4b tempest-GroupsV320Test-1122834609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:19:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2bf60676-308d-4114-aff4-3042d0e16a4b tempest-GroupsV320Test-1122834609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:04 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:19:04 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:05 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6e3d57d8-0645-4eee-b245-dec0e3509613 tempest-VolumesNegativeTest-1175074396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.056s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:05 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-6e3d57d8-0645-4eee-b245-dec0e3509613 tempest-VolumesNegativeTest-1175074396 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:19:05 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-6e3d57d8-0645-4eee-b245-dec0e3509613 tempest-VolumesNegativeTest-1175074396 None] Deleted volume successfully. Jun 29 11:19:05 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-6e3d57d8-0645-4eee-b245-dec0e3509613 tempest-VolumesNegativeTest-1175074396 None] Lock "cinder-f7f3786c-2616-4f83-a2c7-26800f009315-delete_volume" released by "delete_volume" :: held 3.001s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:19:05 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2bf60676-308d-4114-aff4-3042d0e16a4b tempest-GroupsV320Test-1122834609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.858s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:05 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-2bf60676-308d-4114-aff4-3042d0e16a4b tempest-GroupsV320Test-1122834609 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:19:05 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-2bf60676-308d-4114-aff4-3042d0e16a4b tempest-GroupsV320Test-1122834609 None] Delete group completed successfully. Jun 29 11:19:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-bb267a15-fb32-49ee-8d3e-f3719ff97f9c req-adc392d7-5fd6-4e3c-ba19-205c48a6f303 tempest-TestShelveInstance-569084186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:19:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-bb267a15-fb32-49ee-8d3e-f3719ff97f9c req-adc392d7-5fd6-4e3c-ba19-205c48a6f303 tempest-TestShelveInstance-569084186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:19:08 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd741e55-3070-4c94-983a-70ee44a06df7]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:19:08 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:19:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:19:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:19:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:19:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:19:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:19:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-bb267a15-fb32-49ee-8d3e-f3719ff97f9c req-adc392d7-5fd6-4e3c-ba19-205c48a6f303 tempest-TestShelveInstance-569084186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:08 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:19:08 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:08 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819 Jun 29 11:19:08 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:08 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.799s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:08 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:19:08 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager._thread_info {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:19:08 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread count: 29 {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 11:19:08 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread info: [<_MainThread(MainThread, started 131117520400512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 11:19:09 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-bb267a15-fb32-49ee-8d3e-f3719ff97f9c req-adc392d7-5fd6-4e3c-ba19-205c48a6f303 tempest-TestShelveInstance-569084186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819" returned: 0 in 1.141s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-bb267a15-fb32-49ee-8d3e-f3719ff97f9c req-adc392d7-5fd6-4e3c-ba19-205c48a6f303 tempest-TestShelveInstance-569084186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:09 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819 Jun 29 11:19:09 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:10 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-bb267a15-fb32-49ee-8d3e-f3719ff97f9c req-adc392d7-5fd6-4e3c-ba19-205c48a6f303 tempest-TestShelveInstance-569084186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819" returned: 1 in 1.027s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-bb267a15-fb32-49ee-8d3e-f3719ff97f9c req-adc392d7-5fd6-4e3c-ba19-205c48a6f303 tempest-TestShelveInstance-569084186 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:19:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-bb267a15-fb32-49ee-8d3e-f3719ff97f9c req-adc392d7-5fd6-4e3c-ba19-205c48a6f303 tempest-TestShelveInstance-569084186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.282s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:19:10 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-bb267a15-fb32-49ee-8d3e-f3719ff97f9c req-adc392d7-5fd6-4e3c-ba19-205c48a6f303 tempest-TestShelveInstance-569084186 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3', 'name': 'volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '593ad1aa-11f1-409a-90ef-f4ccc5e3d801', 'enforce_multipath': True} {{(pid=93497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 11:19:10 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-bb267a15-fb32-49ee-8d3e-f3719ff97f9c req-adc392d7-5fd6-4e3c-ba19-205c48a6f303 tempest-TestShelveInstance-569084186 None] attachment_update completed successfully. Jun 29 11:19:12 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:19:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] Flow 'volume_create_manager' (fa6e7618-b445-4435-bb73-a036333b5b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:19:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c3126f-b758-4685-a8c0-27b8eef0dfae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c3126f-b758-4685-a8c0-27b8eef0dfae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c868c711-258f-490e-ae61-56d93c3b5e81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5172e735cf1432ba0277db93b14a53b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:19:13Z,use_quota=True,user_id='b919e4c329d14508a768a50e32c00023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46a159dc-1152-481b-954c-a44de92109fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46a159dc-1152-481b-954c-a44de92109fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96f7f004-120f-481f-9d1b-b7c134d38c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96f7f004-120f-481f-9d1b-b7c134d38c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c868c711-258f-490e-ae61-56d93c3b5e81', 'volume_name': 'volume-c868c711-258f-490e-ae61-56d93c3b5e81', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2da9ece-6314-401f-a2e5-e3be197d4fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2da9ece-6314-401f-a2e5-e3be197d4fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7233ca9f-ebb7-4455-8eb8-4a6c3f920b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:12 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] Volume c868c711-258f-490e-ae61-56d93c3b5e81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c868c711-258f-490e-ae61-56d93c3b5e81', 'volume_size': 1} Jun 29 11:19:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:19:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:19:12 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c868c711-258f-490e-ae61-56d93c3b5e81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5172e735cf1432ba0277db93b14a53b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:19:13Z,use_quota=True,user_id='b919e4c329d14508a768a50e32c00023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:19:12 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] Creating volume c868c711-258f-490e-ae61-56d93c3b5e81 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:19:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:19:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:19:12 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:19:12 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:19:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:19:12 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:19:12 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:19:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c868c711-258f-490e-ae61-56d93c3b5e81 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:12 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c868c711-258f-490e-ae61-56d93c3b5e81 1073741824 Jun 29 11:19:12 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:13 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c868c711-258f-490e-ae61-56d93c3b5e81 1073741824" returned: 0 in 1.142s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c868c711-258f-490e-ae61-56d93c3b5e81 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:14 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c868c711-258f-490e-ae61-56d93c3b5e81 Jun 29 11:19:14 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:15 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c868c711-258f-490e-ae61-56d93c3b5e81" returned: 0 in 1.004s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:15 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] <== create_volume: return (2209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:19:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.212s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:19:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7233ca9f-ebb7-4455-8eb8-4a6c3f920b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c868c711-258f-490e-ae61-56d93c3b5e81', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27644f22-7b02-4cbc-b30e-dda6fa646de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:15 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] Volume volume-c868c711-258f-490e-ae61-56d93c3b5e81 (c868c711-258f-490e-ae61-56d93c3b5e81): created successfully Jun 29 11:19:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27644f22-7b02-4cbc-b30e-dda6fa646de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] Flow 'volume_create_manager' (fa6e7618-b445-4435-bb73-a036333b5b0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:19:15 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-26651b7c-3c04-46dc-9dd3-c5ed3c3c315c tempest-CinderUnicodeTest-1906388778 None] Created volume successfully. Jun 29 11:19:16 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:19:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] Flow 'volume_create_manager' (06d2865c-f2c5-44a9-8181-794fd3f3bf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:19:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565f3a1a-0b28-4814-94d9-3858e15b86c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565f3a1a-0b28-4814-94d9-3858e15b86c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1074703061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c98a3dc3-caf3-4a02-bcb1-aca95f6a74e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ac27cc63974310ae49983368958240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:19:17Z,use_quota=True,user_id='1d3bf3d84b624ba2b66e3e8e9a482d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3016e79a-1f5b-4f97-b468-b7ddc881f9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3016e79a-1f5b-4f97-b468-b7ddc881f9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca1629be-ec0b-458b-be9c-59e223a78e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca1629be-ec0b-458b-be9c-59e223a78e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c98a3dc3-caf3-4a02-bcb1-aca95f6a74e0', 'volume_name': 'volume-c98a3dc3-caf3-4a02-bcb1-aca95f6a74e0', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (101da3cc-44b4-42a2-9e59-ccade4dbd0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (101da3cc-44b4-42a2-9e59-ccade4dbd0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c12f1d4-e73e-4d41-9069-fc2722c333c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:16 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] Volume c98a3dc3-caf3-4a02-bcb1-aca95f6a74e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c98a3dc3-caf3-4a02-bcb1-aca95f6a74e0', 'volume_size': 1} Jun 29 11:19:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:19:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:19:16 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1074703061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c98a3dc3-caf3-4a02-bcb1-aca95f6a74e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ac27cc63974310ae49983368958240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:19:17Z,use_quota=True,user_id='1d3bf3d84b624ba2b66e3e8e9a482d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:19:16 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] Creating volume c98a3dc3-caf3-4a02-bcb1-aca95f6a74e0 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:19:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:19:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:19:16 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:19:16 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:19:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:19:16 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:19:16 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:19:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c98a3dc3-caf3-4a02-bcb1-aca95f6a74e0 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:16 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:19:16 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c98a3dc3-caf3-4a02-bcb1-aca95f6a74e0 1073741824 Jun 29 11:19:16 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] Flow 'volume_create_manager' (f4a19e67-a6cf-451b-a815-c8421cae6fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:19:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c82bed-5da8-4cb4-8deb-20cfa2629cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c82bed-5da8-4cb4-8deb-20cfa2629cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:19:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-11233543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af02fba-fe73-4635-9758-ea84f3fa3800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5172e735cf1432ba0277db93b14a53b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:19:17Z,use_quota=True,user_id='b919e4c329d14508a768a50e32c00023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63fbf482-528b-4299-bb5d-d753a39ca184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63fbf482-528b-4299-bb5d-d753a39ca184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9426ece5-d3a6-43a3-93ef-c612ef9bb76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9426ece5-d3a6-43a3-93ef-c612ef9bb76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8af02fba-fe73-4635-9758-ea84f3fa3800', 'volume_name': 'volume-8af02fba-fe73-4635-9758-ea84f3fa3800', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d69c6328-8531-4595-b37c-00e7bd064195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d69c6328-8531-4595-b37c-00e7bd064195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc81f45-35bc-420b-912d-fdfe8917cd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:17 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] Volume 8af02fba-fe73-4635-9758-ea84f3fa3800: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8af02fba-fe73-4635-9758-ea84f3fa3800', 'volume_size': 1} Jun 29 11:19:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:19:18 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c98a3dc3-caf3-4a02-bcb1-aca95f6a74e0 1073741824" returned: 0 in 1.349s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c98a3dc3-caf3-4a02-bcb1-aca95f6a74e0 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:18 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c98a3dc3-caf3-4a02-bcb1-aca95f6a74e0 Jun 29 11:19:18 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:19 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c98a3dc3-caf3-4a02-bcb1-aca95f6a74e0" returned: 0 in 0.935s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:19 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] <== create_volume: return (2358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:19:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.362s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:19:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.193s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:19:19 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:19:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-11233543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af02fba-fe73-4635-9758-ea84f3fa3800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5172e735cf1432ba0277db93b14a53b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:19:17Z,use_quota=True,user_id='b919e4c329d14508a768a50e32c00023',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:19:19 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] Creating volume 8af02fba-fe73-4635-9758-ea84f3fa3800 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:19:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:19:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:19:19 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:19:19 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:19:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:19:19 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:19:19 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:19:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:19 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800 1073741824 Jun 29 11:19:19 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c12f1d4-e73e-4d41-9069-fc2722c333c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c98a3dc3-caf3-4a02-bcb1-aca95f6a74e0', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81de75ee-d56d-4874-bbf0-b5862cde9589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:19 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] Volume volume-c98a3dc3-caf3-4a02-bcb1-aca95f6a74e0 (c98a3dc3-caf3-4a02-bcb1-aca95f6a74e0): created successfully Jun 29 11:19:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81de75ee-d56d-4874-bbf0-b5862cde9589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] Flow 'volume_create_manager' (06d2865c-f2c5-44a9-8181-794fd3f3bf72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:19:19 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-c57505d6-44d7-40c0-b06e-6828e49157de tempest-VolumeQuotasAdminTestJSON-1409107099 None] Created volume successfully. Jun 29 11:19:19 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-623050bb-3a58-402f-9f3f-626f2705f3e9 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Acquiring lock "cinder-c98a3dc3-caf3-4a02-bcb1-aca95f6a74e0-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:19:19 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-623050bb-3a58-402f-9f3f-626f2705f3e9 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Lock "cinder-c98a3dc3-caf3-4a02-bcb1-aca95f6a74e0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:19:20 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-623050bb-3a58-402f-9f3f-626f2705f3e9 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Acquiring lock "cinder-quobyte-c98a3dc3-caf3-4a02-bcb1-aca95f6a74e0" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:19:20 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-623050bb-3a58-402f-9f3f-626f2705f3e9 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Lock "cinder-quobyte-c98a3dc3-caf3-4a02-bcb1-aca95f6a74e0" acquired by "delete_volume" :: waited 0.035s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:19:20 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8764d022-cc30-4f53-99e2-c6e1c6dd7a57]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:19:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-623050bb-3a58-402f-9f3f-626f2705f3e9 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c98a3dc3-caf3-4a02-bcb1-aca95f6a74e0 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:20 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c98a3dc3-caf3-4a02-bcb1-aca95f6a74e0 Jun 29 11:19:20 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:20 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800 1073741824" returned: 0 in 1.239s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:20 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800 Jun 29 11:19:20 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:21 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-623050bb-3a58-402f-9f3f-626f2705f3e9 tempest-VolumeQuotasAdminTestJSON-1409107099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c98a3dc3-caf3-4a02-bcb1-aca95f6a74e0" returned: 0 in 1.765s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-623050bb-3a58-402f-9f3f-626f2705f3e9 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c98a3dc3-caf3-4a02-bcb1-aca95f6a74e0 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:22 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c98a3dc3-caf3-4a02-bcb1-aca95f6a74e0 Jun 29 11:19:22 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:22 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800" returned: 0 in 1.623s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:22 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] <== create_volume: return (2935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:19:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.945s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:19:22 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc81f45-35bc-420b-912d-fdfe8917cd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8af02fba-fe73-4635-9758-ea84f3fa3800', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:22 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bac4b7bc-18ec-436d-9995-b85ff5fc72a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:22 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] Volume volume-8af02fba-fe73-4635-9758-ea84f3fa3800 (8af02fba-fe73-4635-9758-ea84f3fa3800): created successfully Jun 29 11:19:22 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bac4b7bc-18ec-436d-9995-b85ff5fc72a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:22 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] Flow 'volume_create_manager' (f4a19e67-a6cf-451b-a815-c8421cae6fe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:19:22 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-27a28933-dd0f-4c36-8292-0435c3665f3b tempest-CinderUnicodeTest-1906388778 None] Created volume successfully. Jun 29 11:19:23 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-623050bb-3a58-402f-9f3f-626f2705f3e9 tempest-VolumeQuotasAdminTestJSON-1409107099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c98a3dc3-caf3-4a02-bcb1-aca95f6a74e0" returned: 0 in 1.480s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:23 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-623050bb-3a58-402f-9f3f-626f2705f3e9 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Lock "cinder-quobyte-c98a3dc3-caf3-4a02-bcb1-aca95f6a74e0" released by "delete_volume" :: held 3.345s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:19:23 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-623050bb-3a58-402f-9f3f-626f2705f3e9 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Created reservations ['4bf4f2aa-6bbb-4a10-a28f-3c1975191f06', '755ec7c8-62b1-44ed-acc9-1866cc976b47', '2ed416e2-ea1b-4d15-8e57-03d6843c5a3a', '3345b6ce-dac5-42cd-9c9f-6bc096371291'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:19:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-623050bb-3a58-402f-9f3f-626f2705f3e9 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:19:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-623050bb-3a58-402f-9f3f-626f2705f3e9 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:19:23 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-623050bb-3a58-402f-9f3f-626f2705f3e9 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:19:23 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-623050bb-3a58-402f-9f3f-626f2705f3e9 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:19:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-623050bb-3a58-402f-9f3f-626f2705f3e9 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:19:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-623050bb-3a58-402f-9f3f-626f2705f3e9 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:23 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:19:23 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:24 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:19:24 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] Flow 'volume_create_manager' (f2804dc5-b3fd-46c1-af61-ad90421aca92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:19:24 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5293451b-90aa-429c-823e-122b5b34f74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:24 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5293451b-90aa-429c-823e-122b5b34f74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1884358104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0b808ca-4f25-43ca-b2d7-baceeb45a21e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbb71f309274b498b6332bbe0d954e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:19:24Z,use_quota=True,user_id='20dc18654a1640848a66f4bbbf7502a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:24 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0be8270a-0343-4ee4-b009-73534a8e3141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:24 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0be8270a-0343-4ee4-b009-73534a8e3141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:24 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace26819-9fa6-49ad-b2b9-9efac4e8a17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:24 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace26819-9fa6-49ad-b2b9-9efac4e8a17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0b808ca-4f25-43ca-b2d7-baceeb45a21e', 'volume_name': 'volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:24 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa0b6d0d-74e3-4837-bef2-7e28381140bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:24 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa0b6d0d-74e3-4837-bef2-7e28381140bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:24 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c45d335c-8fb0-4a71-9b06-7a9e303b6093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:24 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] Volume e0b808ca-4f25-43ca-b2d7-baceeb45a21e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e', 'volume_size': 1} Jun 29 11:19:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:19:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:19:24 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1884358104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0b808ca-4f25-43ca-b2d7-baceeb45a21e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbb71f309274b498b6332bbe0d954e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:19:24Z,use_quota=True,user_id='20dc18654a1640848a66f4bbbf7502a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:19:24 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] Creating volume e0b808ca-4f25-43ca-b2d7-baceeb45a21e {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:19:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:19:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:19:24 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:19:24 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:19:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:19:24 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:19:24 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:19:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:24 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e 1073741824 Jun 29 11:19:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d89d0023-5def-4df9-9a3e-438f09bfb41a tempest-CinderUnicodeTest-1906388778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:19:24 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:25 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-623050bb-3a58-402f-9f3f-626f2705f3e9 tempest-VolumeQuotasAdminTestJSON-1409107099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.297s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:25 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-623050bb-3a58-402f-9f3f-626f2705f3e9 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:19:25 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-623050bb-3a58-402f-9f3f-626f2705f3e9 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Deleted volume successfully. Jun 29 11:19:25 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-623050bb-3a58-402f-9f3f-626f2705f3e9 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Lock "cinder-c98a3dc3-caf3-4a02-bcb1-aca95f6a74e0-delete_volume" released by "delete_volume" :: held 5.188s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:19:25 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:19:25 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Flow 'volume_create_manager' (8afef61e-6f94-47cc-8f1c-7a231e409f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:19:25 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da88f598-51c4-482c-99ae-55acd3fa35ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:25 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:25 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da88f598-51c4-482c-99ae-55acd3fa35ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1948552184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c319918-6168-4beb-8361-accfb4f1b334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ac27cc63974310ae49983368958240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:19:26Z,use_quota=True,user_id='1d3bf3d84b624ba2b66e3e8e9a482d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:25 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abcdd821-c956-4d72-9d14-2ef5f9d75313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:25 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abcdd821-c956-4d72-9d14-2ef5f9d75313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:25 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8efbeee-8b98-4da4-a84a-285bb4355eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:25 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8efbeee-8b98-4da4-a84a-285bb4355eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c319918-6168-4beb-8361-accfb4f1b334', 'volume_name': 'volume-8c319918-6168-4beb-8361-accfb4f1b334', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:25 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (524d5263-173e-401e-9d2e-fbc5119003b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:25 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (524d5263-173e-401e-9d2e-fbc5119003b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:25 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2418d57-6bb6-4362-91c9-dc4d7d4454f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:25 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Volume 8c319918-6168-4beb-8361-accfb4f1b334: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c319918-6168-4beb-8361-accfb4f1b334', 'volume_size': 1} Jun 29 11:19:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:19:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e 1073741824" returned: 0 in 1.408s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:25 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e Jun 29 11:19:25 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:26 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e" returned: 0 in 0.712s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:26 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] <== create_volume: return (2173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:19:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.178s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:19:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d89d0023-5def-4df9-9a3e-438f09bfb41a tempest-CinderUnicodeTest-1906388778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.105s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:19:26 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c45d335c-8fb0-4a71-9b06-7a9e303b6093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:26 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62403f7f-77b3-4b33-8e71-56ece96dce52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:26 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-d89d0023-5def-4df9-9a3e-438f09bfb41a tempest-CinderUnicodeTest-1906388778 None] Creating offline snapshot f79a6cc8-05a4-4a95-bf98-9d0c1dc1e668 of volume 8af02fba-fe73-4635-9758-ea84f3fa3800 {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:19:26 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] Volume volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e (e0b808ca-4f25-43ca-b2d7-baceeb45a21e): created successfully Jun 29 11:19:26 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62403f7f-77b3-4b33-8e71-56ece96dce52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:26 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] Flow 'volume_create_manager' (f2804dc5-b3fd-46c1-af61-ad90421aca92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:19:26 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[490ee3db-c06b-478d-a842-81c6fad5f95d]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:19:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d89d0023-5def-4df9-9a3e-438f09bfb41a tempest-CinderUnicodeTest-1906388778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:26 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-d3187658-00b0-4147-b9f8-5950668e2a02 tempest-VolumesSnapshotTestJSON-435213628 None] Created volume successfully. Jun 29 11:19:26 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800 Jun 29 11:19:26 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:27 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d89d0023-5def-4df9-9a3e-438f09bfb41a tempest-CinderUnicodeTest-1906388778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800" returned: 0 in 1.004s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d89d0023-5def-4df9-9a3e-438f09bfb41a tempest-CinderUnicodeTest-1906388778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800.f79a6cc8-05a4-4a95-bf98-9d0c1dc1e668 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:27 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800.f79a6cc8-05a4-4a95-bf98-9d0c1dc1e668 1G Jun 29 11:19:27 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b7eef197-4ca5-4851-b3c6-3fd0dd001540 tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:19:28 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d89d0023-5def-4df9-9a3e-438f09bfb41a tempest-CinderUnicodeTest-1906388778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800.f79a6cc8-05a4-4a95-bf98-9d0c1dc1e668 1G" returned: 0 in 1.108s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d89d0023-5def-4df9-9a3e-438f09bfb41a tempest-CinderUnicodeTest-1906388778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8af02fba-fe73-4635-9758-ea84f3fa3800 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800.f79a6cc8-05a4-4a95-bf98-9d0c1dc1e668 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:28 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8af02fba-fe73-4635-9758-ea84f3fa3800 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800.f79a6cc8-05a4-4a95-bf98-9d0c1dc1e668 Jun 29 11:19:28 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:29 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d89d0023-5def-4df9-9a3e-438f09bfb41a tempest-CinderUnicodeTest-1906388778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8af02fba-fe73-4635-9758-ea84f3fa3800 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800.f79a6cc8-05a4-4a95-bf98-9d0c1dc1e668" returned: 0 in 0.663s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:29 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-d89d0023-5def-4df9-9a3e-438f09bfb41a tempest-CinderUnicodeTest-1906388778 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800.f79a6cc8-05a4-4a95-bf98-9d0c1dc1e668 is being set with open permissions: ugo+rw Jun 29 11:19:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d89d0023-5def-4df9-9a3e-438f09bfb41a tempest-CinderUnicodeTest-1906388778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800.f79a6cc8-05a4-4a95-bf98-9d0c1dc1e668 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:29 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800.f79a6cc8-05a4-4a95-bf98-9d0c1dc1e668 Jun 29 11:19:29 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:30 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d89d0023-5def-4df9-9a3e-438f09bfb41a tempest-CinderUnicodeTest-1906388778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800.f79a6cc8-05a4-4a95-bf98-9d0c1dc1e668" returned: 0 in 0.683s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d89d0023-5def-4df9-9a3e-438f09bfb41a tempest-CinderUnicodeTest-1906388778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:30 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800.info Jun 29 11:19:30 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:30 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d89d0023-5def-4df9-9a3e-438f09bfb41a tempest-CinderUnicodeTest-1906388778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800.info" returned: 0 in 0.641s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:30 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-d89d0023-5def-4df9-9a3e-438f09bfb41a tempest-CinderUnicodeTest-1906388778 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800.info is being set with open permissions: ugo+rw Jun 29 11:19:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d89d0023-5def-4df9-9a3e-438f09bfb41a tempest-CinderUnicodeTest-1906388778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:30 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800.info Jun 29 11:19:30 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:31 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d89d0023-5def-4df9-9a3e-438f09bfb41a tempest-CinderUnicodeTest-1906388778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800.info" returned: 0 in 0.623s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d89d0023-5def-4df9-9a3e-438f09bfb41a tempest-CinderUnicodeTest-1906388778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.902s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:19:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.660s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:19:31 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1948552184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c319918-6168-4beb-8361-accfb4f1b334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49ac27cc63974310ae49983368958240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:19:26Z,use_quota=True,user_id='1d3bf3d84b624ba2b66e3e8e9a482d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:19:31 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Creating volume 8c319918-6168-4beb-8361-accfb4f1b334 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:19:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:19:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:19:31 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:19:31 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:19:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:19:31 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:19:31 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:19:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8c319918-6168-4beb-8361-accfb4f1b334 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:31 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8c319918-6168-4beb-8361-accfb4f1b334 1073741824 Jun 29 11:19:31 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:31 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-d89d0023-5def-4df9-9a3e-438f09bfb41a tempest-CinderUnicodeTest-1906388778 None] Create snapshot completed successfully Jun 29 11:19:31 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-536eddd6-10f9-4c0c-8d24-1813e271bd38 tempest-CinderUnicodeTest-1906388778 None] Acquiring lock "cinder-f79a6cc8-05a4-4a95-bf98-9d0c1dc1e668-delete_snapshot" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:19:31 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-536eddd6-10f9-4c0c-8d24-1813e271bd38 tempest-CinderUnicodeTest-1906388778 None] Lock "cinder-f79a6cc8-05a4-4a95-bf98-9d0c1dc1e668-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:19:31 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-536eddd6-10f9-4c0c-8d24-1813e271bd38 tempest-CinderUnicodeTest-1906388778 None] Acquiring lock "cinder-quobyte-8af02fba-fe73-4635-9758-ea84f3fa3800" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:19:31 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-536eddd6-10f9-4c0c-8d24-1813e271bd38 tempest-CinderUnicodeTest-1906388778 None] Lock "cinder-quobyte-8af02fba-fe73-4635-9758-ea84f3fa3800" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:19:31 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-536eddd6-10f9-4c0c-8d24-1813e271bd38 tempest-CinderUnicodeTest-1906388778 None] Acquiring lock "cinder-quobyte-f79a6cc8-05a4-4a95-bf98-9d0c1dc1e668" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:19:31 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-536eddd6-10f9-4c0c-8d24-1813e271bd38 tempest-CinderUnicodeTest-1906388778 None] Lock "cinder-quobyte-f79a6cc8-05a4-4a95-bf98-9d0c1dc1e668" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:19:31 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-536eddd6-10f9-4c0c-8d24-1813e271bd38 tempest-CinderUnicodeTest-1906388778 None] Deleting offline snapshot f79a6cc8-05a4-4a95-bf98-9d0c1dc1e668 of volume 8af02fba-fe73-4635-9758-ea84f3fa3800 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:19:31 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-536eddd6-10f9-4c0c-8d24-1813e271bd38 tempest-CinderUnicodeTest-1906388778 None] snapshot_file for this snap is: volume-8af02fba-fe73-4635-9758-ea84f3fa3800.f79a6cc8-05a4-4a95-bf98-9d0c1dc1e668 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:19:31 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b1b4f6-1eaa-401a-8524-66c77a107c7b]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:19:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-536eddd6-10f9-4c0c-8d24-1813e271bd38 tempest-CinderUnicodeTest-1906388778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800.f79a6cc8-05a4-4a95-bf98-9d0c1dc1e668 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:32 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800.f79a6cc8-05a4-4a95-bf98-9d0c1dc1e668 Jun 29 11:19:32 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:32 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8c319918-6168-4beb-8361-accfb4f1b334 1073741824" returned: 0 in 0.844s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8c319918-6168-4beb-8361-accfb4f1b334 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:32 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8c319918-6168-4beb-8361-accfb4f1b334 Jun 29 11:19:32 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:32 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-536eddd6-10f9-4c0c-8d24-1813e271bd38 tempest-CinderUnicodeTest-1906388778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800.f79a6cc8-05a4-4a95-bf98-9d0c1dc1e668" returned: 0 in 0.863s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:32 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-536eddd6-10f9-4c0c-8d24-1813e271bd38 tempest-CinderUnicodeTest-1906388778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8af02fba-fe73-4635-9758-ea84f3fa3800(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:19:32 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd34f1a6-874c-403a-b83c-ce8d9f7432e3]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:19:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-536eddd6-10f9-4c0c-8d24-1813e271bd38 tempest-CinderUnicodeTest-1906388778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:32 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800 Jun 29 11:19:32 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:33 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8c319918-6168-4beb-8361-accfb4f1b334" returned: 0 in 0.656s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:33 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:19:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:19:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b7eef197-4ca5-4851-b3c6-3fd0dd001540 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.226s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:19:33 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2418d57-6bb6-4362-91c9-dc4d7d4454f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c319918-6168-4beb-8361-accfb4f1b334', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:33 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eafd4ca2-6f38-4d66-9b51-308c4df5ec8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:33 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-b7eef197-4ca5-4851-b3c6-3fd0dd001540 tempest-VolumesSnapshotTestJSON-435213628 None] Creating offline snapshot 21f6a23e-e352-4002-b532-85ab4df915b7 of volume e0b808ca-4f25-43ca-b2d7-baceeb45a21e {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:19:33 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[520b1a75-569b-46e1-8358-7adff2a93ffc]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:19:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b7eef197-4ca5-4851-b3c6-3fd0dd001540 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:33 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Volume volume-8c319918-6168-4beb-8361-accfb4f1b334 (8c319918-6168-4beb-8361-accfb4f1b334): created successfully Jun 29 11:19:33 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eafd4ca2-6f38-4d66-9b51-308c4df5ec8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:33 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Flow 'volume_create_manager' (8afef61e-6f94-47cc-8f1c-7a231e409f99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:19:33 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-44b44622-7357-48bc-b0b3-5e7874a118b4 tempest-VolumeQuotasAdminTestJSON-1409107099 None] Created volume successfully. Jun 29 11:19:33 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e Jun 29 11:19:33 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:33 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-536eddd6-10f9-4c0c-8d24-1813e271bd38 tempest-CinderUnicodeTest-1906388778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800" returned: 0 in 0.803s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-536eddd6-10f9-4c0c-8d24-1813e271bd38 tempest-CinderUnicodeTest-1906388778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800.f79a6cc8-05a4-4a95-bf98-9d0c1dc1e668 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:33 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800.f79a6cc8-05a4-4a95-bf98-9d0c1dc1e668 Jun 29 11:19:33 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:33 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b7eef197-4ca5-4851-b3c6-3fd0dd001540 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e" returned: 0 in 0.850s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b7eef197-4ca5-4851-b3c6-3fd0dd001540 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e.21f6a23e-e352-4002-b532-85ab4df915b7 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:33 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e.21f6a23e-e352-4002-b532-85ab4df915b7 1G Jun 29 11:19:33 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:34 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-536eddd6-10f9-4c0c-8d24-1813e271bd38 tempest-CinderUnicodeTest-1906388778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800.f79a6cc8-05a4-4a95-bf98-9d0c1dc1e668" returned: 0 in 0.832s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-536eddd6-10f9-4c0c-8d24-1813e271bd38 tempest-CinderUnicodeTest-1906388778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800.f79a6cc8-05a4-4a95-bf98-9d0c1dc1e668 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:34 devstack sudo[107797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800.f79a6cc8-05a4-4a95-bf98-9d0c1dc1e668 Jun 29 11:19:34 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:34 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b7eef197-4ca5-4851-b3c6-3fd0dd001540 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e.21f6a23e-e352-4002-b532-85ab4df915b7 1G" returned: 0 in 0.983s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b7eef197-4ca5-4851-b3c6-3fd0dd001540 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e.21f6a23e-e352-4002-b532-85ab4df915b7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:34 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e.21f6a23e-e352-4002-b532-85ab4df915b7 Jun 29 11:19:34 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:35 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-77ac481c-1f0f-46d4-9710-265090163015 tempest-VolumeQuotasAdminTestJSON-1705369421 None] Transfer volume completed successfully. Jun 29 11:19:35 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-536eddd6-10f9-4c0c-8d24-1813e271bd38 tempest-CinderUnicodeTest-1906388778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800.f79a6cc8-05a4-4a95-bf98-9d0c1dc1e668" returned: 0 in 0.777s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:35 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-536eddd6-10f9-4c0c-8d24-1813e271bd38 tempest-CinderUnicodeTest-1906388778 None] Lock "cinder-quobyte-f79a6cc8-05a4-4a95-bf98-9d0c1dc1e668" released by "_delete_snapshot" :: held 3.407s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:19:35 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-536eddd6-10f9-4c0c-8d24-1813e271bd38 tempest-CinderUnicodeTest-1906388778 None] Lock "cinder-quobyte-8af02fba-fe73-4635-9758-ea84f3fa3800" released by "delete_snapshot" :: held 3.432s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:19:35 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-536eddd6-10f9-4c0c-8d24-1813e271bd38 tempest-CinderUnicodeTest-1906388778 None] Created reservations ['93aeb101-a17b-42a8-a1a1-b7e5fac87a1f', 'b27adaeb-5274-42f1-9b46-133865b8a438', '6444d007-e1be-480f-b7d7-5b1a2941f85f', 'ea82a50d-50f0-44f1-b998-f420671ef9a4'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:19:35 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-536eddd6-10f9-4c0c-8d24-1813e271bd38 tempest-CinderUnicodeTest-1906388778 None] Delete snapshot completed successfully. Jun 29 11:19:35 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-536eddd6-10f9-4c0c-8d24-1813e271bd38 tempest-CinderUnicodeTest-1906388778 None] Lock "cinder-f79a6cc8-05a4-4a95-bf98-9d0c1dc1e668-delete_snapshot" released by "delete_snapshot" :: held 3.598s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:19:35 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b7eef197-4ca5-4851-b3c6-3fd0dd001540 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e.21f6a23e-e352-4002-b532-85ab4df915b7" returned: 0 in 0.974s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:35 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-b7eef197-4ca5-4851-b3c6-3fd0dd001540 tempest-VolumesSnapshotTestJSON-435213628 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e.21f6a23e-e352-4002-b532-85ab4df915b7 is being set with open permissions: ugo+rw Jun 29 11:19:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b7eef197-4ca5-4851-b3c6-3fd0dd001540 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e.21f6a23e-e352-4002-b532-85ab4df915b7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:35 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e.21f6a23e-e352-4002-b532-85ab4df915b7 Jun 29 11:19:35 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-947613ca-51e6-4cb8-afbb-ab1a0ad42cf5 tempest-CinderUnicodeTest-1906388778 None] Acquiring lock "cinder-8af02fba-fe73-4635-9758-ea84f3fa3800-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:19:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-947613ca-51e6-4cb8-afbb-ab1a0ad42cf5 tempest-CinderUnicodeTest-1906388778 None] Lock "cinder-8af02fba-fe73-4635-9758-ea84f3fa3800-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:19:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-77c402bf-770a-4110-988e-1f3af88a8fda tempest-VolumeQuotasAdminTestJSON-771431249 None] Acquiring lock "cinder-8c319918-6168-4beb-8361-accfb4f1b334-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:19:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-947613ca-51e6-4cb8-afbb-ab1a0ad42cf5 tempest-CinderUnicodeTest-1906388778 None] Acquiring lock "cinder-quobyte-8af02fba-fe73-4635-9758-ea84f3fa3800" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:19:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-77c402bf-770a-4110-988e-1f3af88a8fda tempest-VolumeQuotasAdminTestJSON-771431249 None] Lock "cinder-8c319918-6168-4beb-8361-accfb4f1b334-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:19:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-947613ca-51e6-4cb8-afbb-ab1a0ad42cf5 tempest-CinderUnicodeTest-1906388778 None] Lock "cinder-quobyte-8af02fba-fe73-4635-9758-ea84f3fa3800" acquired by "delete_volume" :: waited 0.027s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:19:36 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96ebc22-075a-4c61-9f54-e9e09b557691]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:19:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-947613ca-51e6-4cb8-afbb-ab1a0ad42cf5 tempest-CinderUnicodeTest-1906388778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-77c402bf-770a-4110-988e-1f3af88a8fda tempest-VolumeQuotasAdminTestJSON-771431249 None] Acquiring lock "cinder-quobyte-8c319918-6168-4beb-8361-accfb4f1b334" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:19:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-77c402bf-770a-4110-988e-1f3af88a8fda tempest-VolumeQuotasAdminTestJSON-771431249 None] Lock "cinder-quobyte-8c319918-6168-4beb-8361-accfb4f1b334" acquired by "delete_volume" :: waited 0.031s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:19:36 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[78690c31-559d-40bc-be55-6492141f3fea]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:19:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-77c402bf-770a-4110-988e-1f3af88a8fda tempest-VolumeQuotasAdminTestJSON-771431249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8c319918-6168-4beb-8361-accfb4f1b334 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:36 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800 Jun 29 11:19:36 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:36 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8c319918-6168-4beb-8361-accfb4f1b334 Jun 29 11:19:36 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:36 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b7eef197-4ca5-4851-b3c6-3fd0dd001540 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e.21f6a23e-e352-4002-b532-85ab4df915b7" returned: 0 in 0.872s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b7eef197-4ca5-4851-b3c6-3fd0dd001540 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:36 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e.info Jun 29 11:19:36 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:37 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-947613ca-51e6-4cb8-afbb-ab1a0ad42cf5 tempest-CinderUnicodeTest-1906388778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800" returned: 0 in 0.853s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-947613ca-51e6-4cb8-afbb-ab1a0ad42cf5 tempest-CinderUnicodeTest-1906388778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:37 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800 Jun 29 11:19:37 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:37 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-77c402bf-770a-4110-988e-1f3af88a8fda tempest-VolumeQuotasAdminTestJSON-771431249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8c319918-6168-4beb-8361-accfb4f1b334" returned: 0 in 0.933s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-77c402bf-770a-4110-988e-1f3af88a8fda tempest-VolumeQuotasAdminTestJSON-771431249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8c319918-6168-4beb-8361-accfb4f1b334 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:37 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8c319918-6168-4beb-8361-accfb4f1b334 Jun 29 11:19:37 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:37 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b7eef197-4ca5-4851-b3c6-3fd0dd001540 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e.info" returned: 0 in 0.678s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:37 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-b7eef197-4ca5-4851-b3c6-3fd0dd001540 tempest-VolumesSnapshotTestJSON-435213628 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e.info is being set with open permissions: ugo+rw Jun 29 11:19:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b7eef197-4ca5-4851-b3c6-3fd0dd001540 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:37 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e.info Jun 29 11:19:37 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:37 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-947613ca-51e6-4cb8-afbb-ab1a0ad42cf5 tempest-CinderUnicodeTest-1906388778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8af02fba-fe73-4635-9758-ea84f3fa3800" returned: 0 in 0.711s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:37 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-947613ca-51e6-4cb8-afbb-ab1a0ad42cf5 tempest-CinderUnicodeTest-1906388778 None] Lock "cinder-quobyte-8af02fba-fe73-4635-9758-ea84f3fa3800" released by "delete_volume" :: held 1.669s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:19:38 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:38 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-947613ca-51e6-4cb8-afbb-ab1a0ad42cf5 tempest-CinderUnicodeTest-1906388778 None] Created reservations ['a00b0a0c-52b4-4a1a-be63-4c541e34900c', 'b54faf2e-232e-46d7-887c-902e21cf9a0b', 'b5d2e02b-1648-4821-82a9-b73e77120505', '9f348a12-a822-4dbe-a93f-45cdc809539b'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:19:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-77c402bf-770a-4110-988e-1f3af88a8fda tempest-VolumeQuotasAdminTestJSON-771431249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8c319918-6168-4beb-8361-accfb4f1b334" returned: 0 in 0.631s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:38 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-77c402bf-770a-4110-988e-1f3af88a8fda tempest-VolumeQuotasAdminTestJSON-771431249 None] Lock "cinder-quobyte-8c319918-6168-4beb-8361-accfb4f1b334" released by "delete_volume" :: held 1.620s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:19:38 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b7eef197-4ca5-4851-b3c6-3fd0dd001540 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e.info" returned: 0 in 0.627s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b7eef197-4ca5-4851-b3c6-3fd0dd001540 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.115s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:19:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-947613ca-51e6-4cb8-afbb-ab1a0ad42cf5 tempest-CinderUnicodeTest-1906388778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:19:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-947613ca-51e6-4cb8-afbb-ab1a0ad42cf5 tempest-CinderUnicodeTest-1906388778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:19:38 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-947613ca-51e6-4cb8-afbb-ab1a0ad42cf5 tempest-CinderUnicodeTest-1906388778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:19:38 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-947613ca-51e6-4cb8-afbb-ab1a0ad42cf5 tempest-CinderUnicodeTest-1906388778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:19:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-947613ca-51e6-4cb8-afbb-ab1a0ad42cf5 tempest-CinderUnicodeTest-1906388778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:19:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-947613ca-51e6-4cb8-afbb-ab1a0ad42cf5 tempest-CinderUnicodeTest-1906388778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:38 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:19:38 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:38 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-77c402bf-770a-4110-988e-1f3af88a8fda tempest-VolumeQuotasAdminTestJSON-771431249 None] Created reservations ['c15b44a6-a22a-444a-b55c-535eec5a2fd4', '15ccf86b-2007-45ff-92a3-796c7b62bdf7', '92bfd04c-4f49-45e9-ac7a-ae1015847d5c', 'd3a9e62a-51f4-48c6-86c0-6d89a7ed3e3f'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:19:38 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-b7eef197-4ca5-4851-b3c6-3fd0dd001540 tempest-VolumesSnapshotTestJSON-435213628 None] Create snapshot completed successfully Jun 29 11:19:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-77c402bf-770a-4110-988e-1f3af88a8fda tempest-VolumeQuotasAdminTestJSON-771431249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:19:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-77c402bf-770a-4110-988e-1f3af88a8fda tempest-VolumeQuotasAdminTestJSON-771431249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:19:38 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-77c402bf-770a-4110-988e-1f3af88a8fda tempest-VolumeQuotasAdminTestJSON-771431249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:19:38 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-77c402bf-770a-4110-988e-1f3af88a8fda tempest-VolumeQuotasAdminTestJSON-771431249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:19:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-77c402bf-770a-4110-988e-1f3af88a8fda tempest-VolumeQuotasAdminTestJSON-771431249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:19:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-77c402bf-770a-4110-988e-1f3af88a8fda tempest-VolumeQuotasAdminTestJSON-771431249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:38 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:19:38 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:38 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f7dee9d5-6ef9-4089-805a-eaaa42553263 tempest-CinderUnicodeTest-1906388778 None] Acquiring lock "cinder-c868c711-258f-490e-ae61-56d93c3b5e81-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:19:38 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f7dee9d5-6ef9-4089-805a-eaaa42553263 tempest-CinderUnicodeTest-1906388778 None] Lock "cinder-c868c711-258f-490e-ae61-56d93c3b5e81-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:19:38 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f7dee9d5-6ef9-4089-805a-eaaa42553263 tempest-CinderUnicodeTest-1906388778 None] Acquiring lock "cinder-quobyte-c868c711-258f-490e-ae61-56d93c3b5e81" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:19:38 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f7dee9d5-6ef9-4089-805a-eaaa42553263 tempest-CinderUnicodeTest-1906388778 None] Lock "cinder-quobyte-c868c711-258f-490e-ae61-56d93c3b5e81" acquired by "delete_volume" :: waited 0.020s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:19:38 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7df337-301a-4929-b2cb-a0d07b85c784]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:19:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f7dee9d5-6ef9-4089-805a-eaaa42553263 tempest-CinderUnicodeTest-1906388778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c868c711-258f-490e-ae61-56d93c3b5e81 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:38 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c868c711-258f-490e-ae61-56d93c3b5e81 Jun 29 11:19:38 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:38 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-947613ca-51e6-4cb8-afbb-ab1a0ad42cf5 tempest-CinderUnicodeTest-1906388778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.806s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:38 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-947613ca-51e6-4cb8-afbb-ab1a0ad42cf5 tempest-CinderUnicodeTest-1906388778 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:19:38 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-947613ca-51e6-4cb8-afbb-ab1a0ad42cf5 tempest-CinderUnicodeTest-1906388778 None] Deleted volume successfully. Jun 29 11:19:39 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-947613ca-51e6-4cb8-afbb-ab1a0ad42cf5 tempest-CinderUnicodeTest-1906388778 None] Lock "cinder-8af02fba-fe73-4635-9758-ea84f3fa3800-delete_volume" released by "delete_volume" :: held 2.812s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:19:39 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-77c402bf-770a-4110-988e-1f3af88a8fda tempest-VolumeQuotasAdminTestJSON-771431249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.753s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:39 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-77c402bf-770a-4110-988e-1f3af88a8fda tempest-VolumeQuotasAdminTestJSON-771431249 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:19:39 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-77c402bf-770a-4110-988e-1f3af88a8fda tempest-VolumeQuotasAdminTestJSON-771431249 None] Deleted volume successfully. Jun 29 11:19:39 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-77c402bf-770a-4110-988e-1f3af88a8fda tempest-VolumeQuotasAdminTestJSON-771431249 None] Lock "cinder-8c319918-6168-4beb-8361-accfb4f1b334-delete_volume" released by "delete_volume" :: held 2.769s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:19:39 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0931582f-fe08-4e79-9e28-5ac69779c7dd tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "cinder-21f6a23e-e352-4002-b532-85ab4df915b7-delete_snapshot" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:19:39 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0931582f-fe08-4e79-9e28-5ac69779c7dd tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-21f6a23e-e352-4002-b532-85ab4df915b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:19:39 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0931582f-fe08-4e79-9e28-5ac69779c7dd tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "cinder-quobyte-e0b808ca-4f25-43ca-b2d7-baceeb45a21e" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:19:39 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0931582f-fe08-4e79-9e28-5ac69779c7dd tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-quobyte-e0b808ca-4f25-43ca-b2d7-baceeb45a21e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:19:39 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0931582f-fe08-4e79-9e28-5ac69779c7dd tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "cinder-quobyte-21f6a23e-e352-4002-b532-85ab4df915b7" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:19:39 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f7dee9d5-6ef9-4089-805a-eaaa42553263 tempest-CinderUnicodeTest-1906388778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c868c711-258f-490e-ae61-56d93c3b5e81" returned: 0 in 0.905s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f7dee9d5-6ef9-4089-805a-eaaa42553263 tempest-CinderUnicodeTest-1906388778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c868c711-258f-490e-ae61-56d93c3b5e81 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:39 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0931582f-fe08-4e79-9e28-5ac69779c7dd tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-quobyte-21f6a23e-e352-4002-b532-85ab4df915b7" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:19:39 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-0931582f-fe08-4e79-9e28-5ac69779c7dd tempest-VolumesSnapshotTestJSON-435213628 None] Deleting offline snapshot 21f6a23e-e352-4002-b532-85ab4df915b7 of volume e0b808ca-4f25-43ca-b2d7-baceeb45a21e {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:19:39 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c868c711-258f-490e-ae61-56d93c3b5e81 Jun 29 11:19:39 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:39 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-0931582f-fe08-4e79-9e28-5ac69779c7dd tempest-VolumesSnapshotTestJSON-435213628 None] snapshot_file for this snap is: volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e.21f6a23e-e352-4002-b532-85ab4df915b7 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:19:39 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca19f0d-29f1-485d-b958-759aa0f7de9d]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:19:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0931582f-fe08-4e79-9e28-5ac69779c7dd tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e.21f6a23e-e352-4002-b532-85ab4df915b7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:39 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e.21f6a23e-e352-4002-b532-85ab4df915b7 Jun 29 11:19:39 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:40 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f7dee9d5-6ef9-4089-805a-eaaa42553263 tempest-CinderUnicodeTest-1906388778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c868c711-258f-490e-ae61-56d93c3b5e81" returned: 0 in 0.730s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:40 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f7dee9d5-6ef9-4089-805a-eaaa42553263 tempest-CinderUnicodeTest-1906388778 None] Lock "cinder-quobyte-c868c711-258f-490e-ae61-56d93c3b5e81" released by "delete_volume" :: held 1.705s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:19:40 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-f7dee9d5-6ef9-4089-805a-eaaa42553263 tempest-CinderUnicodeTest-1906388778 None] Created reservations ['fd92bc6c-3ff4-4ce9-8fd1-8086a1d26543', '27161ea2-31df-4b27-bd4f-3eaec7a57590', '93162ff8-b33e-4fa5-87d7-41b6fcebb937', '2b200d99-eae7-443d-8fce-78097a10a158'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:19:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f7dee9d5-6ef9-4089-805a-eaaa42553263 tempest-CinderUnicodeTest-1906388778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:19:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f7dee9d5-6ef9-4089-805a-eaaa42553263 tempest-CinderUnicodeTest-1906388778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:19:40 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f7dee9d5-6ef9-4089-805a-eaaa42553263 tempest-CinderUnicodeTest-1906388778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:19:40 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f7dee9d5-6ef9-4089-805a-eaaa42553263 tempest-CinderUnicodeTest-1906388778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:19:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f7dee9d5-6ef9-4089-805a-eaaa42553263 tempest-CinderUnicodeTest-1906388778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:19:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f7dee9d5-6ef9-4089-805a-eaaa42553263 tempest-CinderUnicodeTest-1906388778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:40 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:40 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:19:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0931582f-fe08-4e79-9e28-5ac69779c7dd tempest-VolumesSnapshotTestJSON-435213628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e.21f6a23e-e352-4002-b532-85ab4df915b7" returned: 0 in 0.827s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:40 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-0931582f-fe08-4e79-9e28-5ac69779c7dd tempest-VolumesSnapshotTestJSON-435213628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:19:40 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:40 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f0605f-900b-449a-9d8f-988c10bd3804]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:19:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0931582f-fe08-4e79-9e28-5ac69779c7dd tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:40 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e Jun 29 11:19:40 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:41 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f7dee9d5-6ef9-4089-805a-eaaa42553263 tempest-CinderUnicodeTest-1906388778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.839s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:41 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-f7dee9d5-6ef9-4089-805a-eaaa42553263 tempest-CinderUnicodeTest-1906388778 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:19:41 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-f7dee9d5-6ef9-4089-805a-eaaa42553263 tempest-CinderUnicodeTest-1906388778 None] Deleted volume successfully. Jun 29 11:19:41 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=85,cinder:UPDATE=111,cinder:INSERT=32,cinder:DELETE=9 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:19:41 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f7dee9d5-6ef9-4089-805a-eaaa42553263 tempest-CinderUnicodeTest-1906388778 None] Lock "cinder-c868c711-258f-490e-ae61-56d93c3b5e81-delete_volume" released by "delete_volume" :: held 2.815s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:19:41 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0931582f-fe08-4e79-9e28-5ac69779c7dd tempest-VolumesSnapshotTestJSON-435213628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e" returned: 0 in 0.875s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0931582f-fe08-4e79-9e28-5ac69779c7dd tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e.21f6a23e-e352-4002-b532-85ab4df915b7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:41 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e.21f6a23e-e352-4002-b532-85ab4df915b7 Jun 29 11:19:41 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:42 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0931582f-fe08-4e79-9e28-5ac69779c7dd tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e.21f6a23e-e352-4002-b532-85ab4df915b7" returned: 0 in 0.882s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0931582f-fe08-4e79-9e28-5ac69779c7dd tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e.21f6a23e-e352-4002-b532-85ab4df915b7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:42 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e.21f6a23e-e352-4002-b532-85ab4df915b7 Jun 29 11:19:42 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:43 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0931582f-fe08-4e79-9e28-5ac69779c7dd tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e.21f6a23e-e352-4002-b532-85ab4df915b7" returned: 0 in 0.718s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:43 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=116,cinder:UPDATE=102,cinder:INSERT=28,cinder:DELETE=5 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:19:43 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0931582f-fe08-4e79-9e28-5ac69779c7dd tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-quobyte-21f6a23e-e352-4002-b532-85ab4df915b7" released by "_delete_snapshot" :: held 3.464s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:19:43 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0931582f-fe08-4e79-9e28-5ac69779c7dd tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-quobyte-e0b808ca-4f25-43ca-b2d7-baceeb45a21e" released by "delete_snapshot" :: held 3.499s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:19:43 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-0931582f-fe08-4e79-9e28-5ac69779c7dd tempest-VolumesSnapshotTestJSON-435213628 None] Created reservations ['c0efa0ca-cff9-4e6e-b8de-754553054dab', '3848d2d1-7fb1-42da-9b6e-7ac24f9ea2ec', 'd76e7918-89b0-4c32-90b9-497a990dd8d4', 'e9d1667a-08dc-4f9b-8892-3f2be7644647'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:19:43 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-0931582f-fe08-4e79-9e28-5ac69779c7dd tempest-VolumesSnapshotTestJSON-435213628 None] Delete snapshot completed successfully. Jun 29 11:19:43 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0931582f-fe08-4e79-9e28-5ac69779c7dd tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-21f6a23e-e352-4002-b532-85ab4df915b7-delete_snapshot" released by "delete_snapshot" :: held 3.686s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:19:44 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:19:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] Flow 'volume_create_manager' (d82b9122-c259-421f-ad05-dc2dafe7bfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:19:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef1492f6-7378-48ca-9e1e-14ed5d8babfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef1492f6-7378-48ca-9e1e-14ed5d8babfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2073148491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6cc73de-909c-4af8-80e2-40095f0e4f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbb71f309274b498b6332bbe0d954e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:19:44Z,use_quota=True,user_id='20dc18654a1640848a66f4bbbf7502a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e86573c3-65ac-4c86-8d53-22e5ab666f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e86573c3-65ac-4c86-8d53-22e5ab666f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5315b90c-8188-432e-a045-7084cd0b0371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5315b90c-8188-432e-a045-7084cd0b0371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6cc73de-909c-4af8-80e2-40095f0e4f74', 'volume_name': 'volume-b6cc73de-909c-4af8-80e2-40095f0e4f74', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c2f7f4-cc96-456d-b3a4-fff80de2c266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c2f7f4-cc96-456d-b3a4-fff80de2c266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (514de3bf-7da2-44f6-82ef-cea6d15c6f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:44 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] Volume b6cc73de-909c-4af8-80e2-40095f0e4f74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6cc73de-909c-4af8-80e2-40095f0e4f74', 'volume_size': 1} Jun 29 11:19:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:19:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:19:44 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2073148491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6cc73de-909c-4af8-80e2-40095f0e4f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbb71f309274b498b6332bbe0d954e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:19:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:19:44Z,use_quota=True,user_id='20dc18654a1640848a66f4bbbf7502a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:19:44 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] Creating volume b6cc73de-909c-4af8-80e2-40095f0e4f74 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:19:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:19:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:19:44 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:19:44 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:19:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:19:44 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:19:44 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:19:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:44 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74 1073741824 Jun 29 11:19:44 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:45 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74 1073741824" returned: 0 in 0.956s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:45 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74 Jun 29 11:19:45 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:46 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74" returned: 0 in 0.705s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:19:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:19:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (514de3bf-7da2-44f6-82ef-cea6d15c6f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6cc73de-909c-4af8-80e2-40095f0e4f74', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a916a9-dd2a-4e31-b370-3c64920807b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:46 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] Volume volume-b6cc73de-909c-4af8-80e2-40095f0e4f74 (b6cc73de-909c-4af8-80e2-40095f0e4f74): created successfully Jun 29 11:19:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a916a9-dd2a-4e31-b370-3c64920807b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] Flow 'volume_create_manager' (d82b9122-c259-421f-ad05-dc2dafe7bfa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:19:46 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-2a0323f5-9eff-4419-b46f-061728648736 tempest-VolumesSnapshotTestJSON-435213628 None] Created volume successfully. Jun 29 11:19:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4c43c18c-2379-43c3-92eb-a1227d88f696 tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:19:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4c43c18c-2379-43c3-92eb-a1227d88f696 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:19:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-4c43c18c-2379-43c3-92eb-a1227d88f696 tempest-VolumesSnapshotTestJSON-435213628 None] Creating offline snapshot 82739499-7d50-4afd-8c5f-f12acc65a137 of volume b6cc73de-909c-4af8-80e2-40095f0e4f74 {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:19:46 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efbcbd3-2ecd-4f3c-8c37-ad52471dec33]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:19:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4c43c18c-2379-43c3-92eb-a1227d88f696 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:46 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74 Jun 29 11:19:46 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:47 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4c43c18c-2379-43c3-92eb-a1227d88f696 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74" returned: 0 in 0.900s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4c43c18c-2379-43c3-92eb-a1227d88f696 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74.82739499-7d50-4afd-8c5f-f12acc65a137 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:47 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74.82739499-7d50-4afd-8c5f-f12acc65a137 1G Jun 29 11:19:47 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:48 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4c43c18c-2379-43c3-92eb-a1227d88f696 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74.82739499-7d50-4afd-8c5f-f12acc65a137 1G" returned: 0 in 0.882s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4c43c18c-2379-43c3-92eb-a1227d88f696 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6cc73de-909c-4af8-80e2-40095f0e4f74 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74.82739499-7d50-4afd-8c5f-f12acc65a137 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:48 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6cc73de-909c-4af8-80e2-40095f0e4f74 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74.82739499-7d50-4afd-8c5f-f12acc65a137 Jun 29 11:19:48 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:49 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4c43c18c-2379-43c3-92eb-a1227d88f696 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6cc73de-909c-4af8-80e2-40095f0e4f74 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74.82739499-7d50-4afd-8c5f-f12acc65a137" returned: 0 in 0.936s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:49 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-4c43c18c-2379-43c3-92eb-a1227d88f696 tempest-VolumesSnapshotTestJSON-435213628 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74.82739499-7d50-4afd-8c5f-f12acc65a137 is being set with open permissions: ugo+rw Jun 29 11:19:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4c43c18c-2379-43c3-92eb-a1227d88f696 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74.82739499-7d50-4afd-8c5f-f12acc65a137 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:49 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74.82739499-7d50-4afd-8c5f-f12acc65a137 Jun 29 11:19:49 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:50 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4c43c18c-2379-43c3-92eb-a1227d88f696 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74.82739499-7d50-4afd-8c5f-f12acc65a137" returned: 0 in 0.718s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4c43c18c-2379-43c3-92eb-a1227d88f696 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:50 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74.info Jun 29 11:19:50 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:50 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4c43c18c-2379-43c3-92eb-a1227d88f696 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74.info" returned: 0 in 0.698s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:50 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-4c43c18c-2379-43c3-92eb-a1227d88f696 tempest-VolumesSnapshotTestJSON-435213628 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74.info is being set with open permissions: ugo+rw Jun 29 11:19:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4c43c18c-2379-43c3-92eb-a1227d88f696 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:50 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74.info Jun 29 11:19:50 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:51 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4c43c18c-2379-43c3-92eb-a1227d88f696 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74.info" returned: 0 in 0.685s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4c43c18c-2379-43c3-92eb-a1227d88f696 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.916s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:19:51 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-4c43c18c-2379-43c3-92eb-a1227d88f696 tempest-VolumesSnapshotTestJSON-435213628 None] Create snapshot completed successfully Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] Flow 'volume_create_manager' (3a90062c-584b-4f62-884c-788dcff4cde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8ca50e-6781-438d-8874-6fc58b1ea7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8ca50e-6781-438d-8874-6fc58b1ea7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-39073199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2817f510-f241-4c89-b45d-c887a73d7fde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6bb43c5a75640818d1cb93c67437db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:19:52Z,use_quota=True,user_id='211d20e5c94f4396930bace15cf0c679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33b16e70-f04b-444f-b77b-c1ce2588de54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33b16e70-f04b-444f-b77b-c1ce2588de54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bca3fa05-ee5a-4e2c-910f-20b2585520fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bca3fa05-ee5a-4e2c-910f-20b2585520fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2817f510-f241-4c89-b45d-c887a73d7fde', 'volume_name': 'volume-2817f510-f241-4c89-b45d-c887a73d7fde', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14203a58-c297-453c-8b82-49911b64e2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14203a58-c297-453c-8b82-49911b64e2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a396d04d-319b-41f0-8c5b-2b6427e82265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:52 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] Volume 2817f510-f241-4c89-b45d-c887a73d7fde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2817f510-f241-4c89-b45d-c887a73d7fde', 'volume_size': 1} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-39073199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2817f510-f241-4c89-b45d-c887a73d7fde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6bb43c5a75640818d1cb93c67437db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:19:52Z,use_quota=True,user_id='211d20e5c94f4396930bace15cf0c679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] Creating volume 2817f510-f241-4c89-b45d-c887a73d7fde {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:19:52 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2817f510-f241-4c89-b45d-c887a73d7fde 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:52 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2817f510-f241-4c89-b45d-c887a73d7fde 1073741824 Jun 29 11:19:52 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Flow 'volume_create_manager' (0aa35a2b-7fe0-4eee-b51e-883a5bddba8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626c34a5-8c5e-4786-8f4c-e9f6a000df3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626c34a5-8c5e-4786-8f4c-e9f6a000df3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-954035404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b72d80-d74f-4000-b4e4-0d44a31b05be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbb71f309274b498b6332bbe0d954e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:19:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=82739499-7d50-4afd-8c5f-f12acc65a137,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:19:53Z,use_quota=True,user_id='20dc18654a1640848a66f4bbbf7502a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb8329b-75d9-4f8a-bcb4-f3fc9652e2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb8329b-75d9-4f8a-bcb4-f3fc9652e2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ecd482-6a48-44f5-b91c-970bc9648484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ecd482-6a48-44f5-b91c-970bc9648484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c1b72d80-d74f-4000-b4e4-0d44a31b05be', 'volume_name': 'volume-c1b72d80-d74f-4000-b4e4-0d44a31b05be', 'volume_size': 2, 'snapshot_id': '82739499-7d50-4afd-8c5f-f12acc65a137'}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd0c6f9-080d-4788-b4b1-aa444e3ddddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd0c6f9-080d-4788-b4b1-aa444e3ddddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d929beac-ad43-4b61-a112-3a77074e5533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:52 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Volume c1b72d80-d74f-4000-b4e4-0d44a31b05be: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c1b72d80-d74f-4000-b4e4-0d44a31b05be', 'volume_size': 2, 'snapshot_id': '82739499-7d50-4afd-8c5f-f12acc65a137'} Jun 29 11:19:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:19:53 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2817f510-f241-4c89-b45d-c887a73d7fde 1073741824" returned: 0 in 1.001s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2817f510-f241-4c89-b45d-c887a73d7fde {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:53 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2817f510-f241-4c89-b45d-c887a73d7fde Jun 29 11:19:53 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:53 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-c35a21e4-eaea-4496-9740-1df53ec8bc61 req-5950b99f-63c3-45c2-b8da-00ed20e6e8d9 tempest-TestShelveInstance-569084186 None] Terminate volume connection completed successfully. Jun 29 11:19:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-c35a21e4-eaea-4496-9740-1df53ec8bc61 req-5950b99f-63c3-45c2-b8da-00ed20e6e8d9 tempest-TestShelveInstance-569084186 None] Deleting attachment 593ad1aa-11f1-409a-90ef-f4ccc5e3d801. {{(pid=93497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 11:19:53 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2817f510-f241-4c89-b45d-c887a73d7fde" returned: 0 in 0.682s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:19:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:19:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.111s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:19:53 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "cinder-quobyte-82739499-7d50-4afd-8c5f-f12acc65a137-c1b72d80-d74f-4000-b4e4-0d44a31b05be" by "_create_volume_from_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:19:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a396d04d-319b-41f0-8c5b-2b6427e82265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2817f510-f241-4c89-b45d-c887a73d7fde', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8925f0b5-ffad-4151-b684-d1c2ede1be74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:19:53 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-quobyte-82739499-7d50-4afd-8c5f-f12acc65a137-c1b72d80-d74f-4000-b4e4-0d44a31b05be" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:19:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Creating volume c1b72d80-d74f-4000-b4e4-0d44a31b05be from snapshot 82739499-7d50-4afd-8c5f-f12acc65a137 {{(pid=93497) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 29 11:19:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:19:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:19:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:19:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:19:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:19:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:19:53 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "cinder-quobyte-c1b72d80-d74f-4000-b4e4-0d44a31b05be" by "_copy_volume_from_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:19:53 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] Volume volume-2817f510-f241-4c89-b45d-c887a73d7fde (2817f510-f241-4c89-b45d-c887a73d7fde): created successfully Jun 29 11:19:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8925f0b5-ffad-4151-b684-d1c2ede1be74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:19:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] Flow 'volume_create_manager' (3a90062c-584b-4f62-884c-788dcff4cde8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:19:53 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-quobyte-c1b72d80-d74f-4000-b4e4-0d44a31b05be" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:19:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] snapshot: 82739499-7d50-4afd-8c5f-f12acc65a137, volume: c1b72d80-d74f-4000-b4e4-0d44a31b05be, {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 11:19:53 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-b2367142-2c6e-486a-96d1-930f3cfecb1f tempest-AbsoluteLimitsTests-1223336283 None] Created volume successfully. Jun 29 11:19:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:19:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:19:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:19:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:19:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:19:54 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b439d504-b748-49db-a136-3fdd6f6c8145]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:19:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74.82739499-7d50-4afd-8c5f-f12acc65a137 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:54 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74.82739499-7d50-4afd-8c5f-f12acc65a137 Jun 29 11:19:54 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:54 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d781fa0d-5061-4d97-8d52-051efd38ccdd tempest-AbsoluteLimitsTests-1223336283 None] Acquiring lock "cinder-2817f510-f241-4c89-b45d-c887a73d7fde-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:19:54 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d781fa0d-5061-4d97-8d52-051efd38ccdd tempest-AbsoluteLimitsTests-1223336283 None] Lock "cinder-2817f510-f241-4c89-b45d-c887a73d7fde-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:19:54 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d781fa0d-5061-4d97-8d52-051efd38ccdd tempest-AbsoluteLimitsTests-1223336283 None] Acquiring lock "cinder-quobyte-2817f510-f241-4c89-b45d-c887a73d7fde" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:19:54 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d781fa0d-5061-4d97-8d52-051efd38ccdd tempest-AbsoluteLimitsTests-1223336283 None] Lock "cinder-quobyte-2817f510-f241-4c89-b45d-c887a73d7fde" acquired by "delete_volume" :: waited 0.016s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:19:54 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2bb724-69a6-4455-901f-18016429804d]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:19:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d781fa0d-5061-4d97-8d52-051efd38ccdd tempest-AbsoluteLimitsTests-1223336283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2817f510-f241-4c89-b45d-c887a73d7fde {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:54 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2817f510-f241-4c89-b45d-c887a73d7fde Jun 29 11:19:54 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:54 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74.82739499-7d50-4afd-8c5f-f12acc65a137" returned: 0 in 0.781s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6cc73de-909c-4af8-80e2-40095f0e4f74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:19:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74 {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 11:19:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Creating direct copy from snapshot {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 11:19:54 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e772870-7b49-4c8d-8536-e9b14a355128]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:19:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:54 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74 Jun 29 11:19:54 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:55 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d781fa0d-5061-4d97-8d52-051efd38ccdd tempest-AbsoluteLimitsTests-1223336283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2817f510-f241-4c89-b45d-c887a73d7fde" returned: 0 in 0.809s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d781fa0d-5061-4d97-8d52-051efd38ccdd tempest-AbsoluteLimitsTests-1223336283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2817f510-f241-4c89-b45d-c887a73d7fde {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:55 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2817f510-f241-4c89-b45d-c887a73d7fde Jun 29 11:19:55 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:55 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74" returned: 0 in 0.806s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:55 devstack cinder-volume[93497]: DEBUG cinder.utils [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Path /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c1b72d80-d74f-4000-b4e4-0d44a31b05be not found in is_blk_device check {{(pid=93497) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 11:19:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c1b72d80-d74f-4000-b4e4-0d44a31b05be {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:55 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c1b72d80-d74f-4000-b4e4-0d44a31b05be Jun 29 11:19:55 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:55 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d781fa0d-5061-4d97-8d52-051efd38ccdd tempest-AbsoluteLimitsTests-1223336283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2817f510-f241-4c89-b45d-c887a73d7fde" returned: 0 in 0.694s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d781fa0d-5061-4d97-8d52-051efd38ccdd tempest-AbsoluteLimitsTests-1223336283 None] Lock "cinder-quobyte-2817f510-f241-4c89-b45d-c887a73d7fde" released by "delete_volume" :: held 1.549s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:19:55 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-d781fa0d-5061-4d97-8d52-051efd38ccdd tempest-AbsoluteLimitsTests-1223336283 None] Created reservations ['2b4711db-4888-4cc3-a7c1-1f3e05a646ed', '62c19421-0f3c-468f-a6c3-118f85abd803', '4989c145-eaca-4e2f-85a3-02ea61bccaa7', '5cc970d9-d126-4023-85f3-5f9f41f06f2b'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:19:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d781fa0d-5061-4d97-8d52-051efd38ccdd tempest-AbsoluteLimitsTests-1223336283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:19:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d781fa0d-5061-4d97-8d52-051efd38ccdd tempest-AbsoluteLimitsTests-1223336283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:19:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d781fa0d-5061-4d97-8d52-051efd38ccdd tempest-AbsoluteLimitsTests-1223336283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:19:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d781fa0d-5061-4d97-8d52-051efd38ccdd tempest-AbsoluteLimitsTests-1223336283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:19:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d781fa0d-5061-4d97-8d52-051efd38ccdd tempest-AbsoluteLimitsTests-1223336283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:19:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d781fa0d-5061-4d97-8d52-051efd38ccdd tempest-AbsoluteLimitsTests-1223336283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:19:56 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:19:56 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:19:57 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Jun 29 11:19:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d781fa0d-5061-4d97-8d52-051efd38ccdd tempest-AbsoluteLimitsTests-1223336283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.092s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:19:57 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-d781fa0d-5061-4d97-8d52-051efd38ccdd tempest-AbsoluteLimitsTests-1223336283 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:19:57 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-d781fa0d-5061-4d97-8d52-051efd38ccdd tempest-AbsoluteLimitsTests-1223336283 None] Deleted volume successfully. Jun 29 11:19:57 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d781fa0d-5061-4d97-8d52-051efd38ccdd tempest-AbsoluteLimitsTests-1223336283 None] Lock "cinder-2817f510-f241-4c89-b45d-c887a73d7fde-delete_volume" released by "delete_volume" :: held 2.943s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:19:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-a1d75b17-3d46-4d58-a4e9-ae5cd69c7ef9 req-67504efb-f32f-41bd-abf6-8aafda32e33b tempest-TestShelveInstance-569084186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:20:01 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c1b72d80-d74f-4000-b4e4-0d44a31b05be" returned: 0 in 6.082s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:01 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac78e043-5338-4e93-a39b-ab0c334f2b2c]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:20:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:01 devstack sudo[108122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74 Jun 29 11:20:01 devstack sudo[108122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:02 devstack sudo[108122]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74" returned: 0 in 1.001s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:02 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Image conversion details: src /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74, size 1024.00 MB, duration 6.08 sec, destination /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c1b72d80-d74f-4000-b4e4-0d44a31b05be {{(pid=93497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 11:20:02 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Converted 1024.00 MB image at 168.35 MB/s Jun 29 11:20:02 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c1b72d80-d74f-4000-b4e4-0d44a31b05be is being set with open permissions: ugo+rw Jun 29 11:20:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c1b72d80-d74f-4000-b4e4-0d44a31b05be {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:02 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c1b72d80-d74f-4000-b4e4-0d44a31b05be Jun 29 11:20:02 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:03 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c1b72d80-d74f-4000-b4e4-0d44a31b05be" returned: 0 in 0.632s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-quobyte-c1b72d80-d74f-4000-b4e4-0d44a31b05be" released by "_copy_volume_from_snapshot" :: held 9.430s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:20:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-quobyte-82739499-7d50-4afd-8c5f-f12acc65a137-c1b72d80-d74f-4000-b4e4-0d44a31b05be" released by "_create_volume_from_snapshot" :: held 9.481s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:20:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.511s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:20:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-a1d75b17-3d46-4d58-a4e9-ae5cd69c7ef9 req-67504efb-f32f-41bd-abf6-8aafda32e33b tempest-TestShelveInstance-569084186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.702s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:20:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d929beac-ad43-4b61-a112-3a77074e5533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1b72d80-d74f-4000-b4e4-0d44a31b05be', 'volume_size': 2, 'snapshot_id': '82739499-7d50-4afd-8c5f-f12acc65a137'}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1224709c-b318-4fbe-a3b1-42a2e58428f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:03 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[635e61b8-57b5-4e7f-aa23-e940a943d32a]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:20:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-a1d75b17-3d46-4d58-a4e9-ae5cd69c7ef9 req-67504efb-f32f-41bd-abf6-8aafda32e33b tempest-TestShelveInstance-569084186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:03 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Volume volume-c1b72d80-d74f-4000-b4e4-0d44a31b05be (c1b72d80-d74f-4000-b4e4-0d44a31b05be): created successfully Jun 29 11:20:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1224709c-b318-4fbe-a3b1-42a2e58428f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Flow 'volume_create_manager' (0aa35a2b-7fe0-4eee-b51e-883a5bddba8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:20:03 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-261bfd87-05f1-4c63-97e5-aceebd0555a7 tempest-VolumesSnapshotTestJSON-435213628 None] Created volume successfully. Jun 29 11:20:03 devstack sudo[108130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819 Jun 29 11:20:03 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:03 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:20:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Flow 'volume_create_manager' (c4cf0d6d-4ff7-45b2-9eb5-dbc67ddf9051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:20:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (215cb8ea-b44c-476a-a24f-1745b06ca0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (215cb8ea-b44c-476a-a24f-1745b06ca0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-338219091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6397c60c-89b3-44d7-98d2-de209b0e4d86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='976db1e819324e9c98709b7c2f5464f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:20:04Z,use_quota=True,user_id='b60512e102d14526aafd9eb2ad0090c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d469a604-bec4-4420-bbd1-fa1eeeb2352e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d469a604-bec4-4420-bbd1-fa1eeeb2352e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bbd0559-ae2b-4c75-8631-5d079d210933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:03 devstack cinder-volume[93497]: DEBUG cinder.image.glance [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Creating Keystone auth plugin from conf {{(pid=93497) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 29 11:20:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-9eb3fa02-ce7f-4a4c-891b-e8672e3eb9c0 tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "cinder-c1b72d80-d74f-4000-b4e4-0d44a31b05be-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:20:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-9eb3fa02-ce7f-4a4c-891b-e8672e3eb9c0 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-c1b72d80-d74f-4000-b4e4-0d44a31b05be-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:20:04 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-9eb3fa02-ce7f-4a4c-891b-e8672e3eb9c0 tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "cinder-quobyte-c1b72d80-d74f-4000-b4e4-0d44a31b05be" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:20:04 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-9eb3fa02-ce7f-4a4c-891b-e8672e3eb9c0 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-quobyte-c1b72d80-d74f-4000-b4e4-0d44a31b05be" acquired by "delete_volume" :: waited 0.028s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:20:04 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9985e84f-a443-4815-9786-6bab1b3de983]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:20:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9eb3fa02-ce7f-4a4c-891b-e8672e3eb9c0 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c1b72d80-d74f-4000-b4e4-0d44a31b05be {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:04 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c1b72d80-d74f-4000-b4e4-0d44a31b05be Jun 29 11:20:04 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:04 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-a1d75b17-3d46-4d58-a4e9-ae5cd69c7ef9 req-67504efb-f32f-41bd-abf6-8aafda32e33b tempest-TestShelveInstance-569084186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819" returned: 0 in 0.810s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-a1d75b17-3d46-4d58-a4e9-ae5cd69c7ef9 req-67504efb-f32f-41bd-abf6-8aafda32e33b tempest-TestShelveInstance-569084186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:04 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bbd0559-ae2b-4c75-8631-5d079d210933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6397c60c-89b3-44d7-98d2-de209b0e4d86', 'volume_name': 'volume-6397c60c-89b3-44d7-98d2-de209b0e4d86', 'volume_size': 1, 'image_id': 'e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '376ed9c5d02d4ab0be650a3f1fd75615', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'created_at': datetime.datetime(2026, 6, 29, 8, 56, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 8, 56, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:04 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740b2a1e-a5f6-4ee3-898d-381943ed69cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:04 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740b2a1e-a5f6-4ee3-898d-381943ed69cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:04 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea0d0b4f-1b59-4ece-a67c-11bfcc2b1669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:04 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Volume 6397c60c-89b3-44d7-98d2-de209b0e4d86: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6397c60c-89b3-44d7-98d2-de209b0e4d86', 'volume_size': 1, 'image_id': 'e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '376ed9c5d02d4ab0be650a3f1fd75615', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'created_at': datetime.datetime(2026, 6, 29, 8, 56, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 8, 56, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 29 11:20:04 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Trying to clone 6397c60c-89b3-44d7-98d2-de209b0e4d86 from image e2b32301-75fb-4235-bdc7-d391d7ce88e1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'metadata': {}}]). {{(pid=93497) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 29 11:20:04 devstack sudo[108136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819 Jun 29 11:20:04 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:04 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_tmy1lmendevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93497) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 29 11:20:04 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Image download 20.69 MB at 20.69 MB/s Jun 29 11:20:04 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[55afb022-8766-4c4c-b786-b1d1e101edc8]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:20:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_tmy1lmendevstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:04 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_tmy1lmendevstack@QuobyteHD Jun 29 11:20:04 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:04 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9eb3fa02-ce7f-4a4c-891b-e8672e3eb9c0 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c1b72d80-d74f-4000-b4e4-0d44a31b05be" returned: 0 in 0.833s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9eb3fa02-ce7f-4a4c-891b-e8672e3eb9c0 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c1b72d80-d74f-4000-b4e4-0d44a31b05be {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:04 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c1b72d80-d74f-4000-b4e4-0d44a31b05be Jun 29 11:20:04 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:05 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-a1d75b17-3d46-4d58-a4e9-ae5cd69c7ef9 req-67504efb-f32f-41bd-abf6-8aafda32e33b tempest-TestShelveInstance-569084186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819" returned: 1 in 0.822s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-a1d75b17-3d46-4d58-a4e9-ae5cd69c7ef9 req-67504efb-f32f-41bd-abf6-8aafda32e33b tempest-TestShelveInstance-569084186 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:20:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-a1d75b17-3d46-4d58-a4e9-ae5cd69c7ef9 req-67504efb-f32f-41bd-abf6-8aafda32e33b tempest-TestShelveInstance-569084186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.691s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:20:05 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-a1d75b17-3d46-4d58-a4e9-ae5cd69c7ef9 req-67504efb-f32f-41bd-abf6-8aafda32e33b tempest-TestShelveInstance-569084186 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3', 'name': 'volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd8ea2512-ad15-42aa-a08c-1ee0fb663062', 'enforce_multipath': True} {{(pid=93497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 11:20:05 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-a1d75b17-3d46-4d58-a4e9-ae5cd69c7ef9 req-67504efb-f32f-41bd-abf6-8aafda32e33b tempest-TestShelveInstance-569084186 None] attachment_update completed successfully. Jun 29 11:20:05 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:05 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9eb3fa02-ce7f-4a4c-891b-e8672e3eb9c0 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c1b72d80-d74f-4000-b4e4-0d44a31b05be" returned: 0 in 0.676s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_tmy1lmendevstack@QuobyteHD" returned: 0 in 0.813s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:05 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Temporary image e2b32301-75fb-4235-bdc7-d391d7ce88e1 is fetched for user b60512e102d14526aafd9eb2ad0090c0. {{(pid=93497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 29 11:20:05 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-9eb3fa02-ce7f-4a4c-891b-e8672e3eb9c0 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-quobyte-c1b72d80-d74f-4000-b4e4-0d44a31b05be" released by "delete_volume" :: held 1.562s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:20:05 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-9eb3fa02-ce7f-4a4c-891b-e8672e3eb9c0 tempest-VolumesSnapshotTestJSON-435213628 None] Created reservations ['0a706766-b649-4191-8b7d-f6508324d290', 'c9a66903-ae3a-4574-8b99-42e05ad0dd41', '05ecbde0-ecba-4ab5-992a-e9c2426f2e54', 'b61fd762-1226-4786-99b0-dcd6587d48e5'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:20:05 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[83951216-122e-44d4-948f-7a034253add2]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:20:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_tmy1lmendevstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9eb3fa02-ce7f-4a4c-891b-e8672e3eb9c0 tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:20:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9eb3fa02-ce7f-4a4c-891b-e8672e3eb9c0 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:20:05 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9eb3fa02-ce7f-4a4c-891b-e8672e3eb9c0 tempest-VolumesSnapshotTestJSON-435213628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:20:05 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9eb3fa02-ce7f-4a4c-891b-e8672e3eb9c0 tempest-VolumesSnapshotTestJSON-435213628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:20:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9eb3fa02-ce7f-4a4c-891b-e8672e3eb9c0 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:20:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9eb3fa02-ce7f-4a4c-891b-e8672e3eb9c0 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:05 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:20:05 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:05 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_tmy1lmendevstack@QuobyteHD Jun 29 11:20:05 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-62a63437-55e7-4bd9-a2c5-ee29fb8b0e5c tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "cinder-82739499-7d50-4afd-8c5f-f12acc65a137-delete_snapshot" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:20:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-62a63437-55e7-4bd9-a2c5-ee29fb8b0e5c tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-82739499-7d50-4afd-8c5f-f12acc65a137-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:20:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-62a63437-55e7-4bd9-a2c5-ee29fb8b0e5c tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "cinder-quobyte-b6cc73de-909c-4af8-80e2-40095f0e4f74" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:20:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-62a63437-55e7-4bd9-a2c5-ee29fb8b0e5c tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-quobyte-b6cc73de-909c-4af8-80e2-40095f0e4f74" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:20:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-62a63437-55e7-4bd9-a2c5-ee29fb8b0e5c tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "cinder-quobyte-82739499-7d50-4afd-8c5f-f12acc65a137" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:20:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-62a63437-55e7-4bd9-a2c5-ee29fb8b0e5c tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-quobyte-82739499-7d50-4afd-8c5f-f12acc65a137" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:20:06 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-62a63437-55e7-4bd9-a2c5-ee29fb8b0e5c tempest-VolumesSnapshotTestJSON-435213628 None] Deleting offline snapshot 82739499-7d50-4afd-8c5f-f12acc65a137 of volume b6cc73de-909c-4af8-80e2-40095f0e4f74 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:20:06 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-62a63437-55e7-4bd9-a2c5-ee29fb8b0e5c tempest-VolumesSnapshotTestJSON-435213628 None] snapshot_file for this snap is: volume-b6cc73de-909c-4af8-80e2-40095f0e4f74.82739499-7d50-4afd-8c5f-f12acc65a137 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:20:06 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ee5831-e3ad-4400-83d3-90f17a5e28d1]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:20:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-62a63437-55e7-4bd9-a2c5-ee29fb8b0e5c tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74.82739499-7d50-4afd-8c5f-f12acc65a137 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:06 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9eb3fa02-ce7f-4a4c-891b-e8672e3eb9c0 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.714s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:06 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-9eb3fa02-ce7f-4a4c-891b-e8672e3eb9c0 tempest-VolumesSnapshotTestJSON-435213628 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:20:06 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:06 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-9eb3fa02-ce7f-4a4c-891b-e8672e3eb9c0 tempest-VolumesSnapshotTestJSON-435213628 None] Deleted volume successfully. Jun 29 11:20:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_tmy1lmendevstack@QuobyteHD" returned: 0 in 0.802s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:20:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:20:06 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-338219091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6397c60c-89b3-44d7-98d2-de209b0e4d86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='976db1e819324e9c98709b7c2f5464f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:20:04Z,use_quota=True,user_id='b60512e102d14526aafd9eb2ad0090c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:20:06 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Creating volume 6397c60c-89b3-44d7-98d2-de209b0e4d86 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:20:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:20:06 devstack sudo[108161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74.82739499-7d50-4afd-8c5f-f12acc65a137 Jun 29 11:20:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:20:06 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:06 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:20:06 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:20:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:20:06 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:20:06 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:20:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-9eb3fa02-ce7f-4a4c-891b-e8672e3eb9c0 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-c1b72d80-d74f-4000-b4e4-0d44a31b05be-delete_volume" released by "delete_volume" :: held 2.575s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:20:06 devstack sudo[108163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86 1073741824 Jun 29 11:20:06 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:07 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-62a63437-55e7-4bd9-a2c5-ee29fb8b0e5c tempest-VolumesSnapshotTestJSON-435213628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74.82739499-7d50-4afd-8c5f-f12acc65a137" returned: 0 in 0.836s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:07 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-62a63437-55e7-4bd9-a2c5-ee29fb8b0e5c tempest-VolumesSnapshotTestJSON-435213628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6cc73de-909c-4af8-80e2-40095f0e4f74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:20:07 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbcc1d0-09b4-4b65-b7f5-ab5106b69df0]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:20:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-62a63437-55e7-4bd9-a2c5-ee29fb8b0e5c tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:07 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74 Jun 29 11:20:07 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:07 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86 1073741824" returned: 0 in 0.866s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:07 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86 Jun 29 11:20:07 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:07 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-62a63437-55e7-4bd9-a2c5-ee29fb8b0e5c tempest-VolumesSnapshotTestJSON-435213628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74" returned: 0 in 0.785s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-62a63437-55e7-4bd9-a2c5-ee29fb8b0e5c tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74.82739499-7d50-4afd-8c5f-f12acc65a137 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:08 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74.82739499-7d50-4afd-8c5f-f12acc65a137 Jun 29 11:20:08 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:08 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86" returned: 0 in 0.638s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:20:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:20:08 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager._thread_info {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:20:08 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread count: 29 {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 11:20:08 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread info: [<_MainThread(MainThread, started 131117520400512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 11:20:08 devstack cinder-volume[93497]: DEBUG cinder.volume.volume_utils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Attempting download of e2b32301-75fb-4235-bdc7-d391d7ce88e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'metadata': {}}])) to volume 6397c60c-89b3-44d7-98d2-de209b0e4d86. {{(pid=93497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 29 11:20:08 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adf5dbd-8eb3-4ffa-ba30-dd10b23c4dbb]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:20:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2b32301-75fb-4235-bdc7-d391d7ce88e1_atvwkf0v {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:08 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2b32301-75fb-4235-bdc7-d391d7ce88e1_atvwkf0v Jun 29 11:20:08 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:08 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-62a63437-55e7-4bd9-a2c5-ee29fb8b0e5c tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74.82739499-7d50-4afd-8c5f-f12acc65a137" returned: 0 in 0.717s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-62a63437-55e7-4bd9-a2c5-ee29fb8b0e5c tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74.82739499-7d50-4afd-8c5f-f12acc65a137 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:08 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74.82739499-7d50-4afd-8c5f-f12acc65a137 Jun 29 11:20:08 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:08 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2b32301-75fb-4235-bdc7-d391d7ce88e1_atvwkf0v" returned: 0 in 0.736s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2b32301-75fb-4235-bdc7-d391d7ce88e1_atvwkf0v {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:08 devstack sudo[108193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2b32301-75fb-4235-bdc7-d391d7ce88e1_atvwkf0v Jun 29 11:20:08 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:09 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-62a63437-55e7-4bd9-a2c5-ee29fb8b0e5c tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74.82739499-7d50-4afd-8c5f-f12acc65a137" returned: 0 in 0.656s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-62a63437-55e7-4bd9-a2c5-ee29fb8b0e5c tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-quobyte-82739499-7d50-4afd-8c5f-f12acc65a137" released by "_delete_snapshot" :: held 3.112s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:20:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-62a63437-55e7-4bd9-a2c5-ee29fb8b0e5c tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-quobyte-b6cc73de-909c-4af8-80e2-40095f0e4f74" released by "delete_snapshot" :: held 3.142s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:20:09 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-62a63437-55e7-4bd9-a2c5-ee29fb8b0e5c tempest-VolumesSnapshotTestJSON-435213628 None] Created reservations ['b7463cab-c1ca-459f-84aa-38e24e640dea', 'e6f673dc-d33f-4cb3-b492-6f4e3480542f', '0c26f6b3-f472-4bba-b92f-f2776e959829', '0c98c7c8-1245-412a-b3c0-eb6be7f3a3f9'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:20:09 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-62a63437-55e7-4bd9-a2c5-ee29fb8b0e5c tempest-VolumesSnapshotTestJSON-435213628 None] Delete snapshot completed successfully. Jun 29 11:20:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-62a63437-55e7-4bd9-a2c5-ee29fb8b0e5c tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-82739499-7d50-4afd-8c5f-f12acc65a137-delete_snapshot" released by "delete_snapshot" :: held 3.311s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:20:09 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2b32301-75fb-4235-bdc7-d391d7ce88e1_atvwkf0v" returned: 1 in 0.723s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2b32301-75fb-4235-bdc7-d391d7ce88e1_atvwkf0v' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:20:09 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fde6d6-41c3-4e6b-acac-4273207d661a]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:20:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_tmy1lmendevstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:09 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_tmy1lmendevstack@QuobyteHD Jun 29 11:20:09 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:10 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_tmy1lmendevstack@QuobyteHD" returned: 0 in 0.778s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:10 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] e2b32301-75fb-4235-bdc7-d391d7ce88e1 was qcow2, converting to raw {{(pid=93497) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 29 11:20:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_tmy1lmendevstack@QuobyteHD /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:10 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_tmy1lmendevstack@QuobyteHD /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86 Jun 29 11:20:10 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:10 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-65f1151c-0e40-492a-9fff-b0d8b7c9d555 tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "cinder-b6cc73de-909c-4af8-80e2-40095f0e4f74-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:20:10 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-65f1151c-0e40-492a-9fff-b0d8b7c9d555 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-b6cc73de-909c-4af8-80e2-40095f0e4f74-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:20:10 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-65f1151c-0e40-492a-9fff-b0d8b7c9d555 tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "cinder-quobyte-b6cc73de-909c-4af8-80e2-40095f0e4f74" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:20:10 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-65f1151c-0e40-492a-9fff-b0d8b7c9d555 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-quobyte-b6cc73de-909c-4af8-80e2-40095f0e4f74" acquired by "delete_volume" :: waited 0.033s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:20:10 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e00ca5-1ab9-43de-89f1-3f2047d082d3]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:20:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-65f1151c-0e40-492a-9fff-b0d8b7c9d555 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:10 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74 Jun 29 11:20:10 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:11 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-65f1151c-0e40-492a-9fff-b0d8b7c9d555 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74" returned: 0 in 0.938s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-65f1151c-0e40-492a-9fff-b0d8b7c9d555 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:11 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74 Jun 29 11:20:11 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:12 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-65f1151c-0e40-492a-9fff-b0d8b7c9d555 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b6cc73de-909c-4af8-80e2-40095f0e4f74" returned: 0 in 0.666s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:12 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-65f1151c-0e40-492a-9fff-b0d8b7c9d555 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-quobyte-b6cc73de-909c-4af8-80e2-40095f0e4f74" released by "delete_volume" :: held 1.703s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:20:12 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-65f1151c-0e40-492a-9fff-b0d8b7c9d555 tempest-VolumesSnapshotTestJSON-435213628 None] Created reservations ['0837b23e-dc08-4afb-aa08-4be64faeb6cc', '99033b79-f8a0-4547-82fa-a317fc384fd8', 'db0946d0-304c-4da7-a104-302479d25887', 'b1249f31-a3a2-42b4-b240-8dc7c3e5258e'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:20:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-65f1151c-0e40-492a-9fff-b0d8b7c9d555 tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:20:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-65f1151c-0e40-492a-9fff-b0d8b7c9d555 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:20:12 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-65f1151c-0e40-492a-9fff-b0d8b7c9d555 tempest-VolumesSnapshotTestJSON-435213628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:20:12 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-65f1151c-0e40-492a-9fff-b0d8b7c9d555 tempest-VolumesSnapshotTestJSON-435213628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:20:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-65f1151c-0e40-492a-9fff-b0d8b7c9d555 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:20:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-65f1151c-0e40-492a-9fff-b0d8b7c9d555 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:12 devstack sudo[108235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:20:12 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:12 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_tmy1lmendevstack@QuobyteHD /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86" returned: 0 in 2.305s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:12 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e2b32301-75fb-4235-bdc7-d391d7ce88e1_tmy1lmendevstack@QuobyteHD, size 112.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86 {{(pid=93497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 11:20:12 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Converted 112.00 MB image at 48.56 MB/s Jun 29 11:20:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:12 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86 1G Jun 29 11:20:12 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:13 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-65f1151c-0e40-492a-9fff-b0d8b7c9d555 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.749s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:13 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-65f1151c-0e40-492a-9fff-b0d8b7c9d555 tempest-VolumesSnapshotTestJSON-435213628 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:20:13 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-65f1151c-0e40-492a-9fff-b0d8b7c9d555 tempest-VolumesSnapshotTestJSON-435213628 None] Deleted volume successfully. Jun 29 11:20:13 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-65f1151c-0e40-492a-9fff-b0d8b7c9d555 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-b6cc73de-909c-4af8-80e2-40095f0e4f74-delete_volume" released by "delete_volume" :: held 2.712s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:20:13 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:13 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:20:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] Flow 'volume_create_manager' (0d1be3d1-d201-47e4-bd12-f34f1162cdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:20:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dfaac4b-976b-441b-8a24-eda8ed79a4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86 1G" returned: 0 in 0.855s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dfaac4b-976b-441b-8a24-eda8ed79a4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2048069457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c2d095b-32a4-4a00-bf4a-6c955a819858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbb71f309274b498b6332bbe0d954e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:20:13Z,use_quota=True,user_id='20dc18654a1640848a66f4bbbf7502a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee208dc-1302-49c7-be92-1f29cb074710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee208dc-1302-49c7-be92-1f29cb074710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3bed01d-4440-4a77-89a1-796a1bac5850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3bed01d-4440-4a77-89a1-796a1bac5850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c2d095b-32a4-4a00-bf4a-6c955a819858', 'volume_name': 'volume-5c2d095b-32a4-4a00-bf4a-6c955a819858', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ae500c-7106-4099-b7ec-2323a108f7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ae500c-7106-4099-b7ec-2323a108f7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77fcec3b-1724-4a0b-bcdc-dd2a8e9df979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:13 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] Volume 5c2d095b-32a4-4a00-bf4a-6c955a819858: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c2d095b-32a4-4a00-bf4a-6c955a819858', 'volume_size': 1} Jun 29 11:20:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:20:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:20:13 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2048069457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c2d095b-32a4-4a00-bf4a-6c955a819858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbb71f309274b498b6332bbe0d954e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:20:13Z,use_quota=True,user_id='20dc18654a1640848a66f4bbbf7502a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:20:13 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] Creating volume 5c2d095b-32a4-4a00-bf4a-6c955a819858 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:20:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:20:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:20:13 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:20:13 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:20:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:20:13 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:20:13 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:20:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:13 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b41155-6120-4946-a0c7-5ad6992a0775]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:20:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:13 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858 1073741824 Jun 29 11:20:13 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:13 devstack sudo[108266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86 Jun 29 11:20:13 devstack sudo[108266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:14 devstack sudo[108266]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86" returned: 0 in 0.809s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:14 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:14 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86 Jun 29 11:20:14 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858 1073741824" returned: 0 in 0.946s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:14 devstack sudo[108321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858 Jun 29 11:20:14 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:15 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86" returned: 1 in 0.729s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:20:15 devstack cinder-volume[93497]: DEBUG cinder.volume.volume_utils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Downloaded image e2b32301-75fb-4235-bdc7-d391d7ce88e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'metadata': {}}])) to volume 6397c60c-89b3-44d7-98d2-de209b0e4d86 successfully. {{(pid=93497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 29 11:20:15 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Temporary image e2b32301-75fb-4235-bdc7-d391d7ce88e1 for user b60512e102d14526aafd9eb2ad0090c0 is deleted. {{(pid=93497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 29 11:20:15 devstack cinder-volume[93497]: DEBUG cinder.volume.volume_utils [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Marking volume 6397c60c-89b3-44d7-98d2-de209b0e4d86 as bootable. {{(pid=93497) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 29 11:20:15 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Copying metadata from image e2b32301-75fb-4235-bdc7-d391d7ce88e1 to 6397c60c-89b3-44d7-98d2-de209b0e4d86. {{(pid=93497) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 29 11:20:15 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Creating volume glance metadata for volume 6397c60c-89b3-44d7-98d2-de209b0e4d86 backed by image e2b32301-75fb-4235-bdc7-d391d7ce88e1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93497) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 29 11:20:15 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858" returned: 0 in 0.687s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:15 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:20:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:20:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea0d0b4f-1b59-4ece-a67c-11bfcc2b1669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6397c60c-89b3-44d7-98d2-de209b0e4d86', 'volume_size': 1, 'image_id': 'e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '376ed9c5d02d4ab0be650a3f1fd75615', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2b32301-75fb-4235-bdc7-d391d7ce88e1', 'created_at': datetime.datetime(2026, 6, 29, 8, 56, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 8, 56, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2b32301-75fb-4235-bdc7-d391d7ce88e1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b6af7d-94e8-4826-a61c-b031826f3405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77fcec3b-1724-4a0b-bcdc-dd2a8e9df979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c2d095b-32a4-4a00-bf4a-6c955a819858', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e88bed8-9de0-4a12-a8c8-870cc255386c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:15 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] Volume volume-5c2d095b-32a4-4a00-bf4a-6c955a819858 (5c2d095b-32a4-4a00-bf4a-6c955a819858): created successfully Jun 29 11:20:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e88bed8-9de0-4a12-a8c8-870cc255386c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] Flow 'volume_create_manager' (0d1be3d1-d201-47e4-bd12-f34f1162cdc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:20:15 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Volume volume-6397c60c-89b3-44d7-98d2-de209b0e4d86 (6397c60c-89b3-44d7-98d2-de209b0e4d86): created successfully Jun 29 11:20:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b6af7d-94e8-4826-a61c-b031826f3405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Flow 'volume_create_manager' (c4cf0d6d-4ff7-45b2-9eb5-dbc67ddf9051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:20:15 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-6a960de2-ca26-4fb3-bf7a-0e3099e6b2ed tempest-VolumesSnapshotTestJSON-435213628 None] Created volume successfully. Jun 29 11:20:15 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-57b5986e-1428-415b-9c7a-960cbfcc274a tempest-VolumesExtendTest-1417631155 None] Created volume successfully. Jun 29 11:20:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-6422f230-3fae-4700-b2a5-39215bb910ee tempest-VolumesExtendTest-1417631155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:20:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-6422f230-3fae-4700-b2a5-39215bb910ee tempest-VolumesExtendTest-1417631155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:20:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-92897922-754d-4e71-8202-d1e178730091 tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:20:15 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e44838-27f3-4e1a-93a4-1d113c1d879e]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:20:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6422f230-3fae-4700-b2a5-39215bb910ee tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:15 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86 Jun 29 11:20:15 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:16 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6422f230-3fae-4700-b2a5-39215bb910ee tempest-VolumesExtendTest-1417631155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86" returned: 0 in 0.749s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6422f230-3fae-4700-b2a5-39215bb910ee tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:16 devstack sudo[108650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86 Jun 29 11:20:16 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:17 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6422f230-3fae-4700-b2a5-39215bb910ee tempest-VolumesExtendTest-1417631155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86" returned: 1 in 0.890s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6422f230-3fae-4700-b2a5-39215bb910ee tempest-VolumesExtendTest-1417631155 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:20:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6422f230-3fae-4700-b2a5-39215bb910ee tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86 2G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-6422f230-3fae-4700-b2a5-39215bb910ee tempest-VolumesExtendTest-1417631155 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86 2G" returned: 0 in 0.107s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-6422f230-3fae-4700-b2a5-39215bb910ee tempest-VolumesExtendTest-1417631155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.795s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:20:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-92897922-754d-4e71-8202-d1e178730091 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.802s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:20:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-92897922-754d-4e71-8202-d1e178730091 tempest-VolumesSnapshotTestJSON-435213628 None] Creating offline snapshot aa0e244d-96f1-4beb-90f6-b7b75feace28 of volume 5c2d095b-32a4-4a00-bf4a-6c955a819858 {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:20:17 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ed34b6-bdcd-4fc4-bdf4-fa033ea3c8a4]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:20:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-92897922-754d-4e71-8202-d1e178730091 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:17 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-6422f230-3fae-4700-b2a5-39215bb910ee tempest-VolumesExtendTest-1417631155 None] Extend volume completed successfully. Jun 29 11:20:17 devstack sudo[108713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858 Jun 29 11:20:17 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:18 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-dd97aecc-02a7-4edc-90ce-b293265fe8d9 tempest-VolumesExtendTest-1417631155 None] Acquiring lock "cinder-6397c60c-89b3-44d7-98d2-de209b0e4d86-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:20:18 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-dd97aecc-02a7-4edc-90ce-b293265fe8d9 tempest-VolumesExtendTest-1417631155 None] Lock "cinder-6397c60c-89b3-44d7-98d2-de209b0e4d86-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:20:18 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-dd97aecc-02a7-4edc-90ce-b293265fe8d9 tempest-VolumesExtendTest-1417631155 None] Acquiring lock "cinder-quobyte-6397c60c-89b3-44d7-98d2-de209b0e4d86" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:20:18 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-dd97aecc-02a7-4edc-90ce-b293265fe8d9 tempest-VolumesExtendTest-1417631155 None] Lock "cinder-quobyte-6397c60c-89b3-44d7-98d2-de209b0e4d86" acquired by "delete_volume" :: waited 0.020s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:20:18 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca62782a-7bce-41b6-91fa-8d9ad1883b70]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:20:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dd97aecc-02a7-4edc-90ce-b293265fe8d9 tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:18 devstack sudo[108740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86 Jun 29 11:20:18 devstack sudo[108740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:18 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-92897922-754d-4e71-8202-d1e178730091 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858" returned: 0 in 0.999s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-92897922-754d-4e71-8202-d1e178730091 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858.aa0e244d-96f1-4beb-90f6-b7b75feace28 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:18 devstack sudo[108746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858.aa0e244d-96f1-4beb-90f6-b7b75feace28 1G Jun 29 11:20:18 devstack sudo[108746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:19 devstack sudo[108740]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dd97aecc-02a7-4edc-90ce-b293265fe8d9 tempest-VolumesExtendTest-1417631155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86" returned: 0 in 0.878s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dd97aecc-02a7-4edc-90ce-b293265fe8d9 tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:19 devstack sudo[108755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86 Jun 29 11:20:19 devstack sudo[108755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:19 devstack sudo[108746]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-92897922-754d-4e71-8202-d1e178730091 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858.aa0e244d-96f1-4beb-90f6-b7b75feace28 1G" returned: 0 in 0.989s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-92897922-754d-4e71-8202-d1e178730091 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c2d095b-32a4-4a00-bf4a-6c955a819858 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858.aa0e244d-96f1-4beb-90f6-b7b75feace28 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:19 devstack sudo[108760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c2d095b-32a4-4a00-bf4a-6c955a819858 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858.aa0e244d-96f1-4beb-90f6-b7b75feace28 Jun 29 11:20:19 devstack sudo[108760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:20 devstack sudo[108755]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dd97aecc-02a7-4edc-90ce-b293265fe8d9 tempest-VolumesExtendTest-1417631155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86" returned: 1 in 0.896s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dd97aecc-02a7-4edc-90ce-b293265fe8d9 tempest-VolumesExtendTest-1417631155 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:20:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dd97aecc-02a7-4edc-90ce-b293265fe8d9 tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:20 devstack sudo[108765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86 Jun 29 11:20:20 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:20 devstack sudo[108760]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-92897922-754d-4e71-8202-d1e178730091 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c2d095b-32a4-4a00-bf4a-6c955a819858 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858.aa0e244d-96f1-4beb-90f6-b7b75feace28" returned: 0 in 0.814s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:20 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-92897922-754d-4e71-8202-d1e178730091 tempest-VolumesSnapshotTestJSON-435213628 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858.aa0e244d-96f1-4beb-90f6-b7b75feace28 is being set with open permissions: ugo+rw Jun 29 11:20:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-92897922-754d-4e71-8202-d1e178730091 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858.aa0e244d-96f1-4beb-90f6-b7b75feace28 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:20 devstack sudo[108770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858.aa0e244d-96f1-4beb-90f6-b7b75feace28 Jun 29 11:20:20 devstack sudo[108770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:20 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dd97aecc-02a7-4edc-90ce-b293265fe8d9 tempest-VolumesExtendTest-1417631155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6397c60c-89b3-44d7-98d2-de209b0e4d86" returned: 0 in 0.727s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:20 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-dd97aecc-02a7-4edc-90ce-b293265fe8d9 tempest-VolumesExtendTest-1417631155 None] Lock "cinder-quobyte-6397c60c-89b3-44d7-98d2-de209b0e4d86" released by "delete_volume" :: held 2.587s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:20:20 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-dd97aecc-02a7-4edc-90ce-b293265fe8d9 tempest-VolumesExtendTest-1417631155 None] Created reservations ['c5b7fc22-4898-49f3-bc55-d69d4d7e2491', '6c4b8857-a018-4fab-a019-99d078b7978d', 'fe1d1883-f0cd-4c42-b2c8-294887c43971', '6ee9669a-afdc-44f9-a84f-16e633b5a3b7'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:20:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-dd97aecc-02a7-4edc-90ce-b293265fe8d9 tempest-VolumesExtendTest-1417631155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:20:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-dd97aecc-02a7-4edc-90ce-b293265fe8d9 tempest-VolumesExtendTest-1417631155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:20:21 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-dd97aecc-02a7-4edc-90ce-b293265fe8d9 tempest-VolumesExtendTest-1417631155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:20:21 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-dd97aecc-02a7-4edc-90ce-b293265fe8d9 tempest-VolumesExtendTest-1417631155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:20:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-dd97aecc-02a7-4edc-90ce-b293265fe8d9 tempest-VolumesExtendTest-1417631155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:20:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dd97aecc-02a7-4edc-90ce-b293265fe8d9 tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:21 devstack sudo[108770]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-92897922-754d-4e71-8202-d1e178730091 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858.aa0e244d-96f1-4beb-90f6-b7b75feace28" returned: 0 in 0.716s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:21 devstack sudo[108774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:20:21 devstack sudo[108774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-92897922-754d-4e71-8202-d1e178730091 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:21 devstack sudo[108776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858.info Jun 29 11:20:21 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:21 devstack sudo[108774]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-dd97aecc-02a7-4edc-90ce-b293265fe8d9 tempest-VolumesExtendTest-1417631155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.700s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:21 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-dd97aecc-02a7-4edc-90ce-b293265fe8d9 tempest-VolumesExtendTest-1417631155 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:20:21 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-dd97aecc-02a7-4edc-90ce-b293265fe8d9 tempest-VolumesExtendTest-1417631155 None] Deleted volume successfully. Jun 29 11:20:21 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-dd97aecc-02a7-4edc-90ce-b293265fe8d9 tempest-VolumesExtendTest-1417631155 None] Lock "cinder-6397c60c-89b3-44d7-98d2-de209b0e4d86-delete_volume" released by "delete_volume" :: held 3.549s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:20:21 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-92897922-754d-4e71-8202-d1e178730091 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858.info" returned: 0 in 0.722s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:21 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-92897922-754d-4e71-8202-d1e178730091 tempest-VolumesSnapshotTestJSON-435213628 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858.info is being set with open permissions: ugo+rw Jun 29 11:20:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-92897922-754d-4e71-8202-d1e178730091 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:21 devstack sudo[108780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858.info Jun 29 11:20:21 devstack sudo[108780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:22 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:20:22 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] Flow 'volume_create_manager' (49f6c3be-6fde-4157-8585-8d54badd3a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:20:22 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edce2feb-fe13-4b5f-b112-6786ecb9db1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:22 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edce2feb-fe13-4b5f-b112-6786ecb9db1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-220545503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e1eca4-5506-4f9e-98f1-dc8123d3686e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='976db1e819324e9c98709b7c2f5464f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:20:22Z,use_quota=True,user_id='b60512e102d14526aafd9eb2ad0090c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:22 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e56e6a8b-9118-4adb-a7a3-61c18442393d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:22 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e56e6a8b-9118-4adb-a7a3-61c18442393d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:22 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09e61a7-fe0c-4a89-bf1a-f2380bd25921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:22 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09e61a7-fe0c-4a89-bf1a-f2380bd25921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56e1eca4-5506-4f9e-98f1-dc8123d3686e', 'volume_name': 'volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:22 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (585228a5-49b3-495e-b237-2e0d4526f011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:22 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (585228a5-49b3-495e-b237-2e0d4526f011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:22 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d89bc9a-fbed-4633-8688-c29d19a25d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:22 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] Volume 56e1eca4-5506-4f9e-98f1-dc8123d3686e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e', 'volume_size': 1} Jun 29 11:20:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:20:22 devstack sudo[108780]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-92897922-754d-4e71-8202-d1e178730091 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858.info" returned: 0 in 0.731s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-92897922-754d-4e71-8202-d1e178730091 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.121s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:20:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.158s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:20:22 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-220545503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e1eca4-5506-4f9e-98f1-dc8123d3686e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='976db1e819324e9c98709b7c2f5464f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:20:22Z,use_quota=True,user_id='b60512e102d14526aafd9eb2ad0090c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:20:22 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] Creating volume 56e1eca4-5506-4f9e-98f1-dc8123d3686e {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:20:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:20:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:20:22 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:20:22 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:20:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:20:22 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:20:22 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:20:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:22 devstack sudo[108783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e 1073741824 Jun 29 11:20:22 devstack sudo[108783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:22 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-92897922-754d-4e71-8202-d1e178730091 tempest-VolumesSnapshotTestJSON-435213628 None] Create snapshot completed successfully Jun 29 11:20:23 devstack sudo[108783]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e 1073741824" returned: 0 in 0.911s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:23 devstack sudo[108789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e Jun 29 11:20:23 devstack sudo[108789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:23 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:20:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Flow 'volume_create_manager' (764e725b-b6d0-4ba3-821e-d04d5a0d3444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:20:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (490df4a5-dddd-4512-9a36-cdd8d063a004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (490df4a5-dddd-4512-9a36-cdd8d063a004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-854792258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d84e771b-26db-4db2-a20a-e4bf4080547e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bbb71f309274b498b6332bbe0d954e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aa0e244d-96f1-4beb-90f6-b7b75feace28,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:20:24Z,use_quota=True,user_id='20dc18654a1640848a66f4bbbf7502a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca7f7b4-9db6-429c-8f75-e77b051e6090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca7f7b4-9db6-429c-8f75-e77b051e6090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a5333e-94eb-4310-be2b-f174a3d210ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a5333e-94eb-4310-be2b-f174a3d210ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd84e771b-26db-4db2-a20a-e4bf4080547e', 'volume_name': 'volume-d84e771b-26db-4db2-a20a-e4bf4080547e', 'volume_size': 1, 'snapshot_id': 'aa0e244d-96f1-4beb-90f6-b7b75feace28'}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c267ad3-e966-42a0-9031-adfda3f5f4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c267ad3-e966-42a0-9031-adfda3f5f4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:23 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37325b3c-9845-4970-a1fb-c098ad8189dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:23 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Volume d84e771b-26db-4db2-a20a-e4bf4080547e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d84e771b-26db-4db2-a20a-e4bf4080547e', 'volume_size': 1, 'snapshot_id': 'aa0e244d-96f1-4beb-90f6-b7b75feace28'} Jun 29 11:20:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:20:24 devstack sudo[108789]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e" returned: 0 in 0.657s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:24 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:20:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:20:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.468s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:20:24 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "cinder-quobyte-aa0e244d-96f1-4beb-90f6-b7b75feace28-d84e771b-26db-4db2-a20a-e4bf4080547e" by "_create_volume_from_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:20:24 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d89bc9a-fbed-4633-8688-c29d19a25d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:24 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16dd0ab2-86f9-45ca-a0e9-d34613023cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:24 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-quobyte-aa0e244d-96f1-4beb-90f6-b7b75feace28-d84e771b-26db-4db2-a20a-e4bf4080547e" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:20:24 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Creating volume d84e771b-26db-4db2-a20a-e4bf4080547e from snapshot aa0e244d-96f1-4beb-90f6-b7b75feace28 {{(pid=93497) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 29 11:20:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:20:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:20:24 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:20:24 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:20:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:20:24 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:20:24 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "cinder-quobyte-d84e771b-26db-4db2-a20a-e4bf4080547e" by "_copy_volume_from_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:20:24 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] Volume volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e (56e1eca4-5506-4f9e-98f1-dc8123d3686e): created successfully Jun 29 11:20:24 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16dd0ab2-86f9-45ca-a0e9-d34613023cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:24 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] Flow 'volume_create_manager' (49f6c3be-6fde-4157-8585-8d54badd3a57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:20:24 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-quobyte-d84e771b-26db-4db2-a20a-e4bf4080547e" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:20:24 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] snapshot: aa0e244d-96f1-4beb-90f6-b7b75feace28, volume: d84e771b-26db-4db2-a20a-e4bf4080547e, {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 11:20:24 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-16dd0f6d-aed1-4daf-9d18-85d5ac1c626c tempest-VolumesExtendTest-1417631155 None] Created volume successfully. Jun 29 11:20:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:20:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:20:24 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:20:24 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:20:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:20:24 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edf284d-6af7-42af-9452-fcb3fa6a35df]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:20:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858.aa0e244d-96f1-4beb-90f6-b7b75feace28 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:24 devstack sudo[108792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858.aa0e244d-96f1-4beb-90f6-b7b75feace28 Jun 29 11:20:24 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1141678a-e0d1-4ce8-b9fa-97c4f806c62a tempest-VolumesExtendTest-1417631155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:20:25 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858.aa0e244d-96f1-4beb-90f6-b7b75feace28" returned: 0 in 0.775s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:25 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c2d095b-32a4-4a00-bf4a-6c955a819858(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:20:25 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858 {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 11:20:25 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Creating direct copy from snapshot {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 11:20:25 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d28836d-af2c-48a9-b690-ef31c7988c9e]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:20:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:25 devstack sudo[108797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858 Jun 29 11:20:25 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:25 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858" returned: 0 in 0.774s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:25 devstack cinder-volume[93497]: DEBUG cinder.utils [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Path /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d84e771b-26db-4db2-a20a-e4bf4080547e not found in is_blk_device check {{(pid=93497) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 11:20:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d84e771b-26db-4db2-a20a-e4bf4080547e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:25 devstack sudo[108803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d84e771b-26db-4db2-a20a-e4bf4080547e Jun 29 11:20:25 devstack sudo[108803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:31 devstack sudo[108803]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d84e771b-26db-4db2-a20a-e4bf4080547e" returned: 0 in 5.857s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:31 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5a5680-8822-4dc7-b270-b37ac166607d]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:20:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:31 devstack sudo[108817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858 Jun 29 11:20:31 devstack sudo[108817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:32 devstack sudo[108817]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858" returned: 0 in 0.991s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:32 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Image conversion details: src /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858, size 1024.00 MB, duration 5.86 sec, destination /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d84e771b-26db-4db2-a20a-e4bf4080547e {{(pid=93497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 11:20:32 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Converted 1024.00 MB image at 174.76 MB/s Jun 29 11:20:32 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d84e771b-26db-4db2-a20a-e4bf4080547e is being set with open permissions: ugo+rw Jun 29 11:20:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d84e771b-26db-4db2-a20a-e4bf4080547e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:32 devstack sudo[108828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d84e771b-26db-4db2-a20a-e4bf4080547e Jun 29 11:20:32 devstack sudo[108828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:33 devstack sudo[108828]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d84e771b-26db-4db2-a20a-e4bf4080547e" returned: 0 in 0.622s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:33 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-quobyte-d84e771b-26db-4db2-a20a-e4bf4080547e" released by "_copy_volume_from_snapshot" :: held 9.124s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:20:33 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-quobyte-aa0e244d-96f1-4beb-90f6-b7b75feace28-d84e771b-26db-4db2-a20a-e4bf4080547e" released by "_create_volume_from_snapshot" :: held 9.171s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:20:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.210s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:20:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1141678a-e0d1-4ce8-b9fa-97c4f806c62a tempest-VolumesExtendTest-1417631155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.797s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:20:33 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-1141678a-e0d1-4ce8-b9fa-97c4f806c62a tempest-VolumesExtendTest-1417631155 None] Creating offline snapshot bd32ad8a-d5f5-47a9-9ea2-6a1edd6aa05c of volume 56e1eca4-5506-4f9e-98f1-dc8123d3686e {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:20:33 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37325b3c-9845-4970-a1fb-c098ad8189dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d84e771b-26db-4db2-a20a-e4bf4080547e', 'volume_size': 1, 'snapshot_id': 'aa0e244d-96f1-4beb-90f6-b7b75feace28'}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:33 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b96ea1dc-ae25-4abe-908e-81d2996f4452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:33 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d434d4b9-ca78-438e-81a5-df49f00a5204]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:20:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1141678a-e0d1-4ce8-b9fa-97c4f806c62a tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:33 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Volume volume-d84e771b-26db-4db2-a20a-e4bf4080547e (d84e771b-26db-4db2-a20a-e4bf4080547e): created successfully Jun 29 11:20:33 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b96ea1dc-ae25-4abe-908e-81d2996f4452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:33 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Flow 'volume_create_manager' (764e725b-b6d0-4ba3-821e-d04d5a0d3444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:20:33 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-c4c60e2e-f3ee-4a0e-8731-f5b6d55db65a tempest-VolumesSnapshotTestJSON-435213628 None] Created volume successfully. Jun 29 11:20:33 devstack sudo[108831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e Jun 29 11:20:33 devstack sudo[108831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:33 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4593285c-dfe3-4b7f-9761-97feefe1a910 tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "cinder-d84e771b-26db-4db2-a20a-e4bf4080547e-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:20:33 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4593285c-dfe3-4b7f-9761-97feefe1a910 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-d84e771b-26db-4db2-a20a-e4bf4080547e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:20:33 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4593285c-dfe3-4b7f-9761-97feefe1a910 tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "cinder-quobyte-d84e771b-26db-4db2-a20a-e4bf4080547e" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:20:33 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4593285c-dfe3-4b7f-9761-97feefe1a910 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-quobyte-d84e771b-26db-4db2-a20a-e4bf4080547e" acquired by "delete_volume" :: waited 0.015s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:20:34 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddebc9cd-0192-413f-a67e-9aa4cedb97b6]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:20:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4593285c-dfe3-4b7f-9761-97feefe1a910 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d84e771b-26db-4db2-a20a-e4bf4080547e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:34 devstack sudo[108857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d84e771b-26db-4db2-a20a-e4bf4080547e Jun 29 11:20:34 devstack sudo[108857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:34 devstack sudo[108831]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1141678a-e0d1-4ce8-b9fa-97c4f806c62a tempest-VolumesExtendTest-1417631155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e" returned: 0 in 0.767s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1141678a-e0d1-4ce8-b9fa-97c4f806c62a tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e.bd32ad8a-d5f5-47a9-9ea2-6a1edd6aa05c 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:34 devstack sudo[108862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e.bd32ad8a-d5f5-47a9-9ea2-6a1edd6aa05c 1G Jun 29 11:20:34 devstack sudo[108862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:34 devstack sudo[108857]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4593285c-dfe3-4b7f-9761-97feefe1a910 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d84e771b-26db-4db2-a20a-e4bf4080547e" returned: 0 in 0.747s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4593285c-dfe3-4b7f-9761-97feefe1a910 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d84e771b-26db-4db2-a20a-e4bf4080547e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:34 devstack sudo[108867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d84e771b-26db-4db2-a20a-e4bf4080547e Jun 29 11:20:34 devstack sudo[108867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:35 devstack sudo[108862]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1141678a-e0d1-4ce8-b9fa-97c4f806c62a tempest-VolumesExtendTest-1417631155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e.bd32ad8a-d5f5-47a9-9ea2-6a1edd6aa05c 1G" returned: 0 in 0.821s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1141678a-e0d1-4ce8-b9fa-97c4f806c62a tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e.bd32ad8a-d5f5-47a9-9ea2-6a1edd6aa05c {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:35 devstack sudo[108872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e.bd32ad8a-d5f5-47a9-9ea2-6a1edd6aa05c Jun 29 11:20:35 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:35 devstack sudo[108867]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4593285c-dfe3-4b7f-9761-97feefe1a910 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d84e771b-26db-4db2-a20a-e4bf4080547e" returned: 0 in 0.711s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:35 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4593285c-dfe3-4b7f-9761-97feefe1a910 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-quobyte-d84e771b-26db-4db2-a20a-e4bf4080547e" released by "delete_volume" :: held 1.498s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:20:35 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-4593285c-dfe3-4b7f-9761-97feefe1a910 tempest-VolumesSnapshotTestJSON-435213628 None] Created reservations ['89971e78-0dd8-47a7-8aef-296e32487bd7', 'c06bb7ae-c6be-4746-9682-25effc0d3809', '2b7418fc-2da3-4238-b923-fb98f9b2378d', '6f8f4560-96ba-4907-aaaf-319a790dbd02'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:20:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4593285c-dfe3-4b7f-9761-97feefe1a910 tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:20:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4593285c-dfe3-4b7f-9761-97feefe1a910 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:20:35 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4593285c-dfe3-4b7f-9761-97feefe1a910 tempest-VolumesSnapshotTestJSON-435213628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:20:35 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4593285c-dfe3-4b7f-9761-97feefe1a910 tempest-VolumesSnapshotTestJSON-435213628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:20:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4593285c-dfe3-4b7f-9761-97feefe1a910 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:20:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4593285c-dfe3-4b7f-9761-97feefe1a910 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:35 devstack sudo[108875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:20:35 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:35 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1141678a-e0d1-4ce8-b9fa-97c4f806c62a tempest-VolumesExtendTest-1417631155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e.bd32ad8a-d5f5-47a9-9ea2-6a1edd6aa05c" returned: 0 in 0.665s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:35 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-1141678a-e0d1-4ce8-b9fa-97c4f806c62a tempest-VolumesExtendTest-1417631155 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e.bd32ad8a-d5f5-47a9-9ea2-6a1edd6aa05c is being set with open permissions: ugo+rw Jun 29 11:20:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1141678a-e0d1-4ce8-b9fa-97c4f806c62a tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e.bd32ad8a-d5f5-47a9-9ea2-6a1edd6aa05c {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:35 devstack sudo[108880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e.bd32ad8a-d5f5-47a9-9ea2-6a1edd6aa05c Jun 29 11:20:35 devstack sudo[108880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c412cb34-334e-42dc-a8e9-1d6f19689a60 tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "cinder-aa0e244d-96f1-4beb-90f6-b7b75feace28-delete_snapshot" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:20:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c412cb34-334e-42dc-a8e9-1d6f19689a60 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-aa0e244d-96f1-4beb-90f6-b7b75feace28-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:20:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c412cb34-334e-42dc-a8e9-1d6f19689a60 tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "cinder-quobyte-5c2d095b-32a4-4a00-bf4a-6c955a819858" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:20:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c412cb34-334e-42dc-a8e9-1d6f19689a60 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-quobyte-5c2d095b-32a4-4a00-bf4a-6c955a819858" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:20:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c412cb34-334e-42dc-a8e9-1d6f19689a60 tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "cinder-quobyte-aa0e244d-96f1-4beb-90f6-b7b75feace28" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:20:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c412cb34-334e-42dc-a8e9-1d6f19689a60 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-quobyte-aa0e244d-96f1-4beb-90f6-b7b75feace28" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:20:36 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-c412cb34-334e-42dc-a8e9-1d6f19689a60 tempest-VolumesSnapshotTestJSON-435213628 None] Deleting offline snapshot aa0e244d-96f1-4beb-90f6-b7b75feace28 of volume 5c2d095b-32a4-4a00-bf4a-6c955a819858 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:20:36 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-c412cb34-334e-42dc-a8e9-1d6f19689a60 tempest-VolumesSnapshotTestJSON-435213628 None] snapshot_file for this snap is: volume-5c2d095b-32a4-4a00-bf4a-6c955a819858.aa0e244d-96f1-4beb-90f6-b7b75feace28 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:20:36 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4593285c-dfe3-4b7f-9761-97feefe1a910 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.684s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:36 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-4593285c-dfe3-4b7f-9761-97feefe1a910 tempest-VolumesSnapshotTestJSON-435213628 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:20:36 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[003c70f3-0d3e-43c2-ab5a-269d753d29d4]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:20:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c412cb34-334e-42dc-a8e9-1d6f19689a60 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858.aa0e244d-96f1-4beb-90f6-b7b75feace28 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:36 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-4593285c-dfe3-4b7f-9761-97feefe1a910 tempest-VolumesSnapshotTestJSON-435213628 None] Deleted volume successfully. Jun 29 11:20:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4593285c-dfe3-4b7f-9761-97feefe1a910 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-d84e771b-26db-4db2-a20a-e4bf4080547e-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:20:36 devstack sudo[108883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858.aa0e244d-96f1-4beb-90f6-b7b75feace28 Jun 29 11:20:36 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:36 devstack sudo[108880]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1141678a-e0d1-4ce8-b9fa-97c4f806c62a tempest-VolumesExtendTest-1417631155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e.bd32ad8a-d5f5-47a9-9ea2-6a1edd6aa05c" returned: 0 in 0.698s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1141678a-e0d1-4ce8-b9fa-97c4f806c62a tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:36 devstack sudo[108886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e.info Jun 29 11:20:36 devstack sudo[108886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:37 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c412cb34-334e-42dc-a8e9-1d6f19689a60 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858.aa0e244d-96f1-4beb-90f6-b7b75feace28" returned: 0 in 0.761s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:37 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-c412cb34-334e-42dc-a8e9-1d6f19689a60 tempest-VolumesSnapshotTestJSON-435213628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c2d095b-32a4-4a00-bf4a-6c955a819858(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:20:37 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c636d77c-f085-4cc1-aa17-263c90ad62b2]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:20:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c412cb34-334e-42dc-a8e9-1d6f19689a60 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:37 devstack sudo[108886]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1141678a-e0d1-4ce8-b9fa-97c4f806c62a tempest-VolumesExtendTest-1417631155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e.info" returned: 0 in 0.616s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:37 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-1141678a-e0d1-4ce8-b9fa-97c4f806c62a tempest-VolumesExtendTest-1417631155 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e.info is being set with open permissions: ugo+rw Jun 29 11:20:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1141678a-e0d1-4ce8-b9fa-97c4f806c62a tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:37 devstack sudo[108893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e.info Jun 29 11:20:37 devstack sudo[108893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:37 devstack sudo[108892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858 Jun 29 11:20:37 devstack sudo[108892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:37 devstack sudo[108893]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1141678a-e0d1-4ce8-b9fa-97c4f806c62a tempest-VolumesExtendTest-1417631155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e.info" returned: 0 in 0.610s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1141678a-e0d1-4ce8-b9fa-97c4f806c62a tempest-VolumesExtendTest-1417631155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.288s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:20:37 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-1141678a-e0d1-4ce8-b9fa-97c4f806c62a tempest-VolumesExtendTest-1417631155 None] Create snapshot completed successfully Jun 29 11:20:37 devstack sudo[108892]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c412cb34-334e-42dc-a8e9-1d6f19689a60 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858" returned: 0 in 0.784s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c412cb34-334e-42dc-a8e9-1d6f19689a60 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858.aa0e244d-96f1-4beb-90f6-b7b75feace28 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:37 devstack sudo[108901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858.aa0e244d-96f1-4beb-90f6-b7b75feace28 Jun 29 11:20:37 devstack sudo[108901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d0af52dd-bbbc-412e-bc2e-c18b281238ef tempest-VolumesExtendTest-1417631155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:20:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d0af52dd-bbbc-412e-bc2e-c18b281238ef tempest-VolumesExtendTest-1417631155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:20:38 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd57934-26c0-4677-9029-d445826d73cd]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:20:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d0af52dd-bbbc-412e-bc2e-c18b281238ef tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:38 devstack sudo[108901]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c412cb34-334e-42dc-a8e9-1d6f19689a60 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858.aa0e244d-96f1-4beb-90f6-b7b75feace28" returned: 0 in 0.773s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c412cb34-334e-42dc-a8e9-1d6f19689a60 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858.aa0e244d-96f1-4beb-90f6-b7b75feace28 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:38 devstack sudo[108908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858.aa0e244d-96f1-4beb-90f6-b7b75feace28 Jun 29 11:20:38 devstack sudo[108908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:38 devstack sudo[108907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e Jun 29 11:20:38 devstack sudo[108907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:39 devstack sudo[108908]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c412cb34-334e-42dc-a8e9-1d6f19689a60 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858.aa0e244d-96f1-4beb-90f6-b7b75feace28" returned: 0 in 0.656s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:39 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c412cb34-334e-42dc-a8e9-1d6f19689a60 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-quobyte-aa0e244d-96f1-4beb-90f6-b7b75feace28" released by "_delete_snapshot" :: held 3.083s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:20:39 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c412cb34-334e-42dc-a8e9-1d6f19689a60 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-quobyte-5c2d095b-32a4-4a00-bf4a-6c955a819858" released by "delete_snapshot" :: held 3.113s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:20:39 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-c412cb34-334e-42dc-a8e9-1d6f19689a60 tempest-VolumesSnapshotTestJSON-435213628 None] Created reservations ['37682982-a9cc-4c91-af48-432ee0dee3d8', 'c24337bb-6f78-49b4-bf67-75478b44377d', '78d2e036-394d-46a7-b8fd-af8170bbc11c', '0c30414a-3b90-400b-9329-3220f4c144b2'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:20:39 devstack sudo[108907]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d0af52dd-bbbc-412e-bc2e-c18b281238ef tempest-VolumesExtendTest-1417631155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e" returned: 0 in 0.820s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d0af52dd-bbbc-412e-bc2e-c18b281238ef tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e.bd32ad8a-d5f5-47a9-9ea2-6a1edd6aa05c 2G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:39 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-c412cb34-334e-42dc-a8e9-1d6f19689a60 tempest-VolumesSnapshotTestJSON-435213628 None] Delete snapshot completed successfully. Jun 29 11:20:39 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-c412cb34-334e-42dc-a8e9-1d6f19689a60 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-aa0e244d-96f1-4beb-90f6-b7b75feace28-delete_snapshot" released by "delete_snapshot" :: held 3.317s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:20:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d0af52dd-bbbc-412e-bc2e-c18b281238ef tempest-VolumesExtendTest-1417631155 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e.bd32ad8a-d5f5-47a9-9ea2-6a1edd6aa05c 2G" returned: 0 in 0.191s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d0af52dd-bbbc-412e-bc2e-c18b281238ef tempest-VolumesExtendTest-1417631155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.050s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:20:39 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-d0af52dd-bbbc-412e-bc2e-c18b281238ef tempest-VolumesExtendTest-1417631155 None] Extend volume completed successfully. Jun 29 11:20:40 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3b410636-38f9-43b5-95e3-41392a84f63d tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "cinder-5c2d095b-32a4-4a00-bf4a-6c955a819858-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:20:40 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3b410636-38f9-43b5-95e3-41392a84f63d tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-5c2d095b-32a4-4a00-bf4a-6c955a819858-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:20:40 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3b410636-38f9-43b5-95e3-41392a84f63d tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "cinder-quobyte-5c2d095b-32a4-4a00-bf4a-6c955a819858" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:20:40 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3b410636-38f9-43b5-95e3-41392a84f63d tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-quobyte-5c2d095b-32a4-4a00-bf4a-6c955a819858" acquired by "delete_volume" :: waited 0.014s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:20:40 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a8ce2e-eed0-42c0-b127-40dd7d83c6d0]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:20:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3b410636-38f9-43b5-95e3-41392a84f63d tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:40 devstack sudo[108919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858 Jun 29 11:20:40 devstack sudo[108919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:40 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-5d09b7dc-d1c4-4aee-a67f-373fc74941bc tempest-VolumesExtendTest-1417631155 None] Acquiring lock "cinder-bd32ad8a-d5f5-47a9-9ea2-6a1edd6aa05c-delete_snapshot" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:20:40 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-5d09b7dc-d1c4-4aee-a67f-373fc74941bc tempest-VolumesExtendTest-1417631155 None] Lock "cinder-bd32ad8a-d5f5-47a9-9ea2-6a1edd6aa05c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:20:40 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-5d09b7dc-d1c4-4aee-a67f-373fc74941bc tempest-VolumesExtendTest-1417631155 None] Acquiring lock "cinder-quobyte-56e1eca4-5506-4f9e-98f1-dc8123d3686e" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:20:40 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-5d09b7dc-d1c4-4aee-a67f-373fc74941bc tempest-VolumesExtendTest-1417631155 None] Lock "cinder-quobyte-56e1eca4-5506-4f9e-98f1-dc8123d3686e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:20:40 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-5d09b7dc-d1c4-4aee-a67f-373fc74941bc tempest-VolumesExtendTest-1417631155 None] Acquiring lock "cinder-quobyte-bd32ad8a-d5f5-47a9-9ea2-6a1edd6aa05c" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:20:40 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-5d09b7dc-d1c4-4aee-a67f-373fc74941bc tempest-VolumesExtendTest-1417631155 None] Lock "cinder-quobyte-bd32ad8a-d5f5-47a9-9ea2-6a1edd6aa05c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:20:40 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-5d09b7dc-d1c4-4aee-a67f-373fc74941bc tempest-VolumesExtendTest-1417631155 None] Deleting offline snapshot bd32ad8a-d5f5-47a9-9ea2-6a1edd6aa05c of volume 56e1eca4-5506-4f9e-98f1-dc8123d3686e {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:20:40 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-5d09b7dc-d1c4-4aee-a67f-373fc74941bc tempest-VolumesExtendTest-1417631155 None] snapshot_file for this snap is: volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e.bd32ad8a-d5f5-47a9-9ea2-6a1edd6aa05c {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:20:40 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6dcaca-be48-43d0-b5a6-04c1109b2e4f]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:20:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5d09b7dc-d1c4-4aee-a67f-373fc74941bc tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e.bd32ad8a-d5f5-47a9-9ea2-6a1edd6aa05c {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:41 devstack sudo[108921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e.bd32ad8a-d5f5-47a9-9ea2-6a1edd6aa05c Jun 29 11:20:41 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:41 devstack sudo[108919]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3b410636-38f9-43b5-95e3-41392a84f63d tempest-VolumesSnapshotTestJSON-435213628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858" returned: 0 in 0.746s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3b410636-38f9-43b5-95e3-41392a84f63d tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:41 devstack sudo[108926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858 Jun 29 11:20:41 devstack sudo[108926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:41 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5d09b7dc-d1c4-4aee-a67f-373fc74941bc tempest-VolumesExtendTest-1417631155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e.bd32ad8a-d5f5-47a9-9ea2-6a1edd6aa05c" returned: 0 in 0.760s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:41 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-5d09b7dc-d1c4-4aee-a67f-373fc74941bc tempest-VolumesExtendTest-1417631155 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:20:41 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfc462f-f2a7-4e01-96f9-3d58a8e39ca2]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:20:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5d09b7dc-d1c4-4aee-a67f-373fc74941bc tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:41 devstack sudo[108931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e Jun 29 11:20:41 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:42 devstack sudo[108926]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3b410636-38f9-43b5-95e3-41392a84f63d tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5c2d095b-32a4-4a00-bf4a-6c955a819858" returned: 0 in 0.660s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:42 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3b410636-38f9-43b5-95e3-41392a84f63d tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-quobyte-5c2d095b-32a4-4a00-bf4a-6c955a819858" released by "delete_volume" :: held 1.464s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:20:42 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=79,cinder:INSERT=27,cinder:UPDATE=99,cinder:DELETE=7 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:20:42 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-3b410636-38f9-43b5-95e3-41392a84f63d tempest-VolumesSnapshotTestJSON-435213628 None] Created reservations ['e1575ffb-c970-4447-844f-9eb988cb39fe', '0c0b5234-87dc-4e3c-9932-a8c93912f5f5', '91cf11df-d604-4aca-ad92-29d64b1844e9', '4c2037a7-2122-4db8-a6c2-be9555762542'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:20:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3b410636-38f9-43b5-95e3-41392a84f63d tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:20:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3b410636-38f9-43b5-95e3-41392a84f63d tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:20:42 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-3b410636-38f9-43b5-95e3-41392a84f63d tempest-VolumesSnapshotTestJSON-435213628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:20:42 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-3b410636-38f9-43b5-95e3-41392a84f63d tempest-VolumesSnapshotTestJSON-435213628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:20:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3b410636-38f9-43b5-95e3-41392a84f63d tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:20:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3b410636-38f9-43b5-95e3-41392a84f63d tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:42 devstack sudo[108934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:20:42 devstack sudo[108934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:42 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5d09b7dc-d1c4-4aee-a67f-373fc74941bc tempest-VolumesExtendTest-1417631155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e" returned: 0 in 0.763s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5d09b7dc-d1c4-4aee-a67f-373fc74941bc tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e.bd32ad8a-d5f5-47a9-9ea2-6a1edd6aa05c {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:42 devstack sudo[108939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e.bd32ad8a-d5f5-47a9-9ea2-6a1edd6aa05c Jun 29 11:20:42 devstack sudo[108939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:42 devstack sudo[108934]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3b410636-38f9-43b5-95e3-41392a84f63d tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.639s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:42 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-3b410636-38f9-43b5-95e3-41392a84f63d tempest-VolumesSnapshotTestJSON-435213628 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:20:42 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-84daa8cd-7e4a-4963-97e5-1dbab4820222 tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "cinder-e0b808ca-4f25-43ca-b2d7-baceeb45a21e-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:20:42 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-3b410636-38f9-43b5-95e3-41392a84f63d tempest-VolumesSnapshotTestJSON-435213628 None] Deleted volume successfully. Jun 29 11:20:42 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-84daa8cd-7e4a-4963-97e5-1dbab4820222 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-e0b808ca-4f25-43ca-b2d7-baceeb45a21e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:20:42 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3b410636-38f9-43b5-95e3-41392a84f63d tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-5c2d095b-32a4-4a00-bf4a-6c955a819858-delete_volume" released by "delete_volume" :: held 2.335s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:20:42 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-84daa8cd-7e4a-4963-97e5-1dbab4820222 tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "cinder-quobyte-e0b808ca-4f25-43ca-b2d7-baceeb45a21e" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:20:42 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-84daa8cd-7e4a-4963-97e5-1dbab4820222 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-quobyte-e0b808ca-4f25-43ca-b2d7-baceeb45a21e" acquired by "delete_volume" :: waited 0.016s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:20:42 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f22799-9506-4dd1-a71b-ec29d1d45240]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:20:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-84daa8cd-7e4a-4963-97e5-1dbab4820222 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:43 devstack sudo[108942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e Jun 29 11:20:43 devstack sudo[108942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:43 devstack sudo[108939]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5d09b7dc-d1c4-4aee-a67f-373fc74941bc tempest-VolumesExtendTest-1417631155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e.bd32ad8a-d5f5-47a9-9ea2-6a1edd6aa05c" returned: 0 in 0.792s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5d09b7dc-d1c4-4aee-a67f-373fc74941bc tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e.bd32ad8a-d5f5-47a9-9ea2-6a1edd6aa05c {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:43 devstack sudo[108947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e.bd32ad8a-d5f5-47a9-9ea2-6a1edd6aa05c Jun 29 11:20:43 devstack sudo[108947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:43 devstack sudo[108942]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-84daa8cd-7e4a-4963-97e5-1dbab4820222 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e" returned: 0 in 0.795s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-84daa8cd-7e4a-4963-97e5-1dbab4820222 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:43 devstack sudo[108953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e Jun 29 11:20:43 devstack sudo[108953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:43 devstack sudo[108947]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5d09b7dc-d1c4-4aee-a67f-373fc74941bc tempest-VolumesExtendTest-1417631155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e.bd32ad8a-d5f5-47a9-9ea2-6a1edd6aa05c" returned: 0 in 0.649s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:43 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=100,cinder:INSERT=28,cinder:UPDATE=86,cinder:DELETE=8 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:20:44 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-5d09b7dc-d1c4-4aee-a67f-373fc74941bc tempest-VolumesExtendTest-1417631155 None] Lock "cinder-quobyte-bd32ad8a-d5f5-47a9-9ea2-6a1edd6aa05c" released by "_delete_snapshot" :: held 3.069s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:20:44 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-5d09b7dc-d1c4-4aee-a67f-373fc74941bc tempest-VolumesExtendTest-1417631155 None] Lock "cinder-quobyte-56e1eca4-5506-4f9e-98f1-dc8123d3686e" released by "delete_snapshot" :: held 3.099s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:20:44 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-5d09b7dc-d1c4-4aee-a67f-373fc74941bc tempest-VolumesExtendTest-1417631155 None] Created reservations ['ec262779-ca5f-4baa-bc67-3ffcff654165', '6ffed3a3-dfd7-4a91-b5c5-edc57e1e2420', '19ac059d-27a8-475a-ba96-2c786a9e3154', '531d80c4-a960-405c-9ef7-47a42fba6240'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:20:44 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-5d09b7dc-d1c4-4aee-a67f-373fc74941bc tempest-VolumesExtendTest-1417631155 None] Delete snapshot completed successfully. Jun 29 11:20:44 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-5d09b7dc-d1c4-4aee-a67f-373fc74941bc tempest-VolumesExtendTest-1417631155 None] Lock "cinder-bd32ad8a-d5f5-47a9-9ea2-6a1edd6aa05c-delete_snapshot" released by "delete_snapshot" :: held 3.237s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:20:44 devstack sudo[108953]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-84daa8cd-7e4a-4963-97e5-1dbab4820222 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-e0b808ca-4f25-43ca-b2d7-baceeb45a21e" returned: 0 in 0.619s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:44 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-84daa8cd-7e4a-4963-97e5-1dbab4820222 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-quobyte-e0b808ca-4f25-43ca-b2d7-baceeb45a21e" released by "delete_volume" :: held 1.466s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:20:44 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-84daa8cd-7e4a-4963-97e5-1dbab4820222 tempest-VolumesSnapshotTestJSON-435213628 None] Created reservations ['56cd92a3-004b-43fa-9a38-beaea9e11796', '82bf967f-de7a-4c92-842f-f3cc3863e6bd', 'dcd627b6-df5a-480f-9d0f-ff9fcae71f0e', '08a1d9b0-c415-4e27-8232-f19f4d547cd3'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:20:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-84daa8cd-7e4a-4963-97e5-1dbab4820222 tempest-VolumesSnapshotTestJSON-435213628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:20:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-84daa8cd-7e4a-4963-97e5-1dbab4820222 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:20:44 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-84daa8cd-7e4a-4963-97e5-1dbab4820222 tempest-VolumesSnapshotTestJSON-435213628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:20:44 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-84daa8cd-7e4a-4963-97e5-1dbab4820222 tempest-VolumesSnapshotTestJSON-435213628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:20:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-84daa8cd-7e4a-4963-97e5-1dbab4820222 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:20:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-84daa8cd-7e4a-4963-97e5-1dbab4820222 tempest-VolumesSnapshotTestJSON-435213628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:44 devstack sudo[108957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:20:44 devstack sudo[108957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:45 devstack sudo[108957]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-84daa8cd-7e4a-4963-97e5-1dbab4820222 tempest-VolumesSnapshotTestJSON-435213628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.628s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:45 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-84daa8cd-7e4a-4963-97e5-1dbab4820222 tempest-VolumesSnapshotTestJSON-435213628 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:20:45 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-84daa8cd-7e4a-4963-97e5-1dbab4820222 tempest-VolumesSnapshotTestJSON-435213628 None] Deleted volume successfully. Jun 29 11:20:45 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-84daa8cd-7e4a-4963-97e5-1dbab4820222 tempest-VolumesSnapshotTestJSON-435213628 None] Lock "cinder-e0b808ca-4f25-43ca-b2d7-baceeb45a21e-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:20:45 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-33b5fb16-f193-47c5-82f1-36eda9477734 tempest-VolumesExtendTest-1417631155 None] Acquiring lock "cinder-56e1eca4-5506-4f9e-98f1-dc8123d3686e-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:20:45 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-33b5fb16-f193-47c5-82f1-36eda9477734 tempest-VolumesExtendTest-1417631155 None] Lock "cinder-56e1eca4-5506-4f9e-98f1-dc8123d3686e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:20:45 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-33b5fb16-f193-47c5-82f1-36eda9477734 tempest-VolumesExtendTest-1417631155 None] Acquiring lock "cinder-quobyte-56e1eca4-5506-4f9e-98f1-dc8123d3686e" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:20:45 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-33b5fb16-f193-47c5-82f1-36eda9477734 tempest-VolumesExtendTest-1417631155 None] Lock "cinder-quobyte-56e1eca4-5506-4f9e-98f1-dc8123d3686e" acquired by "delete_volume" :: waited 0.013s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:20:45 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5cd331-0d2c-427b-983a-56a95fda19d2]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:20:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-33b5fb16-f193-47c5-82f1-36eda9477734 tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:45 devstack sudo[108961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e Jun 29 11:20:45 devstack sudo[108961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:46 devstack sudo[108961]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-33b5fb16-f193-47c5-82f1-36eda9477734 tempest-VolumesExtendTest-1417631155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e" returned: 0 in 0.803s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-33b5fb16-f193-47c5-82f1-36eda9477734 tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:46 devstack sudo[108966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e Jun 29 11:20:46 devstack sudo[108966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:46 devstack sudo[108966]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-33b5fb16-f193-47c5-82f1-36eda9477734 tempest-VolumesExtendTest-1417631155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-56e1eca4-5506-4f9e-98f1-dc8123d3686e" returned: 0 in 0.632s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:46 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-33b5fb16-f193-47c5-82f1-36eda9477734 tempest-VolumesExtendTest-1417631155 None] Lock "cinder-quobyte-56e1eca4-5506-4f9e-98f1-dc8123d3686e" released by "delete_volume" :: held 1.496s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:20:46 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-33b5fb16-f193-47c5-82f1-36eda9477734 tempest-VolumesExtendTest-1417631155 None] Created reservations ['39727444-fc40-4c99-9057-401847b2f58d', '21e79f22-3476-4c8b-8cec-426f490c95c8', '2da7b5b9-d404-46ed-966b-050a9828f1ad', 'b3be7301-1350-4b03-ae3b-1c4dc98a205c'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:20:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-33b5fb16-f193-47c5-82f1-36eda9477734 tempest-VolumesExtendTest-1417631155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:20:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-33b5fb16-f193-47c5-82f1-36eda9477734 tempest-VolumesExtendTest-1417631155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:20:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-33b5fb16-f193-47c5-82f1-36eda9477734 tempest-VolumesExtendTest-1417631155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:20:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-33b5fb16-f193-47c5-82f1-36eda9477734 tempest-VolumesExtendTest-1417631155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:20:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-33b5fb16-f193-47c5-82f1-36eda9477734 tempest-VolumesExtendTest-1417631155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:20:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-33b5fb16-f193-47c5-82f1-36eda9477734 tempest-VolumesExtendTest-1417631155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:46 devstack sudo[108970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:20:46 devstack sudo[108970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:47 devstack sudo[108970]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-33b5fb16-f193-47c5-82f1-36eda9477734 tempest-VolumesExtendTest-1417631155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.841s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:47 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-33b5fb16-f193-47c5-82f1-36eda9477734 tempest-VolumesExtendTest-1417631155 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:20:47 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-33b5fb16-f193-47c5-82f1-36eda9477734 tempest-VolumesExtendTest-1417631155 None] Deleted volume successfully. Jun 29 11:20:47 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-33b5fb16-f193-47c5-82f1-36eda9477734 tempest-VolumesExtendTest-1417631155 None] Lock "cinder-56e1eca4-5506-4f9e-98f1-dc8123d3686e-delete_volume" released by "delete_volume" :: held 2.542s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] Flow 'volume_create_manager' (3f1768f7-f6fc-4820-a555-e5552e5df08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (381328de-e762-4c14-a32a-a1faadd92f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (381328de-e762-4c14-a32a-a1faadd92f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2074677259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6565da74-eef9-4654-ab3b-56b29e2b8dfa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67d6ce5508d9481ca621d096cde23598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:20:51Z,use_quota=True,user_id='98e0d128e34e401f9723693625cd8526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f66f2f21-522e-4c07-8f77-a2f925ff8b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f66f2f21-522e-4c07-8f77-a2f925ff8b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d762494-277e-4f7e-abc2-64d1fb730486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d762494-277e-4f7e-abc2-64d1fb730486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6565da74-eef9-4654-ab3b-56b29e2b8dfa', 'volume_name': 'volume-6565da74-eef9-4654-ab3b-56b29e2b8dfa', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (708f3d4c-27a2-4112-b4af-8402562272e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (708f3d4c-27a2-4112-b4af-8402562272e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bbc8e31-6228-47b3-8e71-3fea30f5264a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:51 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] Volume 6565da74-eef9-4654-ab3b-56b29e2b8dfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6565da74-eef9-4654-ab3b-56b29e2b8dfa', 'volume_size': 1} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2074677259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6565da74-eef9-4654-ab3b-56b29e2b8dfa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67d6ce5508d9481ca621d096cde23598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:20:51Z,use_quota=True,user_id='98e0d128e34e401f9723693625cd8526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] Creating volume 6565da74-eef9-4654-ab3b-56b29e2b8dfa {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:20:51 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6565da74-eef9-4654-ab3b-56b29e2b8dfa 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:51 devstack sudo[108977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6565da74-eef9-4654-ab3b-56b29e2b8dfa 1073741824 Jun 29 11:20:51 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Flow 'volume_create_manager' (396a3719-028b-484f-af18-261944514065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8a0fd4-7732-4dcc-aa22-7a49d79c808f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8a0fd4-7732-4dcc-aa22-7a49d79c808f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-552458926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a181773-c53f-411b-98b3-701ba9898580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f07a2baa6e4608b3877bc8a7a949bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:20:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:20:51Z,use_quota=True,user_id='ffbde9ef1d2e4398b85c22f5e4c5e426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0599ce0-18f9-4193-8fb3-f6dd8442b495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0599ce0-18f9-4193-8fb3-f6dd8442b495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f767c827-0fef-41b1-b7ec-0b839821320a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f767c827-0fef-41b1-b7ec-0b839821320a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a181773-c53f-411b-98b3-701ba9898580', 'volume_name': 'volume-4a181773-c53f-411b-98b3-701ba9898580', 'volume_size': 2}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4530ced6-9436-45a4-bcd5-c56976852b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4530ced6-9436-45a4-bcd5-c56976852b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a0a2ae-7ed7-4c57-b1bd-c5ecbd5e1919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:51 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Volume 4a181773-c53f-411b-98b3-701ba9898580: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a181773-c53f-411b-98b3-701ba9898580', 'volume_size': 2} Jun 29 11:20:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:20:52 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6565da74-eef9-4654-ab3b-56b29e2b8dfa 1073741824" returned: 0 in 0.772s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6565da74-eef9-4654-ab3b-56b29e2b8dfa {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:52 devstack sudo[108983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6565da74-eef9-4654-ab3b-56b29e2b8dfa Jun 29 11:20:52 devstack sudo[108983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:52 devstack sudo[108983]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6565da74-eef9-4654-ab3b-56b29e2b8dfa" returned: 0 in 0.607s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:52 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:20:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:20:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.310s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:20:52 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-552458926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a181773-c53f-411b-98b3-701ba9898580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f07a2baa6e4608b3877bc8a7a949bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:20:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:20:51Z,use_quota=True,user_id='ffbde9ef1d2e4398b85c22f5e4c5e426',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:20:52 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Creating volume 4a181773-c53f-411b-98b3-701ba9898580 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:20:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:20:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:20:52 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:20:52 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:20:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:20:52 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:20:52 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:20:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580 2147483648 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bbc8e31-6228-47b3-8e71-3fea30f5264a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6565da74-eef9-4654-ab3b-56b29e2b8dfa', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:52 devstack sudo[108986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580 2147483648 Jun 29 11:20:52 devstack sudo[108986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0246383-0d05-4379-baac-20df860c63ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:52 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] Volume volume-6565da74-eef9-4654-ab3b-56b29e2b8dfa (6565da74-eef9-4654-ab3b-56b29e2b8dfa): created successfully Jun 29 11:20:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0246383-0d05-4379-baac-20df860c63ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] Flow 'volume_create_manager' (3f1768f7-f6fc-4820-a555-e5552e5df08e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:20:52 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-7ecc447f-bcca-4fb2-96ab-61f2f72a7392 tempest-VolumesListTestJSON-1848553934 None] Created volume successfully. Jun 29 11:20:53 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:20:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] Flow 'volume_create_manager' (1f65b1dd-94c6-4c2a-9b6f-863269a27085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:20:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8395fef-19e7-4e39-b37b-ece06e85f0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:53 devstack sudo[108986]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8395fef-19e7-4e39-b37b-ece06e85f0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1567797795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2de240a-1d86-405b-8f9a-4dd2ef162796,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67d6ce5508d9481ca621d096cde23598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:20:54Z,use_quota=True,user_id='98e0d128e34e401f9723693625cd8526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7b56dc-ca27-4448-a1b7-3234f3dc6aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7b56dc-ca27-4448-a1b7-3234f3dc6aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a14951-a345-4bd7-a40a-c5044e0ac8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a14951-a345-4bd7-a40a-c5044e0ac8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2de240a-1d86-405b-8f9a-4dd2ef162796', 'volume_name': 'volume-f2de240a-1d86-405b-8f9a-4dd2ef162796', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f4ddd4e-e76c-4ee0-b447-d4a089b8b7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f4ddd4e-e76c-4ee0-b447-d4a089b8b7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f4a5e6-028b-42bd-aac9-7274d71d4d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:53 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] Volume f2de240a-1d86-405b-8f9a-4dd2ef162796: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2de240a-1d86-405b-8f9a-4dd2ef162796', 'volume_size': 1} Jun 29 11:20:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:20:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580 2147483648" returned: 0 in 1.005s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:53 devstack sudo[109027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580 Jun 29 11:20:53 devstack sudo[109027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:54 devstack sudo[109027]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580" returned: 0 in 0.628s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:20:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:20:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.664s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:20:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1567797795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2de240a-1d86-405b-8f9a-4dd2ef162796,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67d6ce5508d9481ca621d096cde23598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:20:54Z,use_quota=True,user_id='98e0d128e34e401f9723693625cd8526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:20:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] Creating volume f2de240a-1d86-405b-8f9a-4dd2ef162796 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:20:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:20:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:20:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:20:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:20:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:20:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:20:54 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:20:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f2de240a-1d86-405b-8f9a-4dd2ef162796 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a0a2ae-7ed7-4c57-b1bd-c5ecbd5e1919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a181773-c53f-411b-98b3-701ba9898580', 'volume_size': 2}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:54 devstack sudo[109030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f2de240a-1d86-405b-8f9a-4dd2ef162796 1073741824 Jun 29 11:20:54 devstack sudo[109030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ceefa4b-4119-42b8-9f4e-e3fd4cd7f9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:54 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Volume volume-4a181773-c53f-411b-98b3-701ba9898580 (4a181773-c53f-411b-98b3-701ba9898580): created successfully Jun 29 11:20:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ceefa4b-4119-42b8-9f4e-e3fd4cd7f9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Flow 'volume_create_manager' (396a3719-028b-484f-af18-261944514065) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:20:54 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-ede11879-0367-455f-8f13-78ff8a2ad0b3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Created volume successfully. Jun 29 11:20:55 devstack sudo[109030]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f2de240a-1d86-405b-8f9a-4dd2ef162796 1073741824" returned: 0 in 0.776s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f2de240a-1d86-405b-8f9a-4dd2ef162796 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:55 devstack sudo[109035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f2de240a-1d86-405b-8f9a-4dd2ef162796 Jun 29 11:20:55 devstack sudo[109035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-98959fd1-e154-407c-a5f4-8e2a433700cc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:20:55 devstack sudo[109035]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f2de240a-1d86-405b-8f9a-4dd2ef162796" returned: 0 in 0.701s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:55 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:20:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:20:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-98959fd1-e154-407c-a5f4-8e2a433700cc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.397s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:20:55 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f4a5e6-028b-42bd-aac9-7274d71d4d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2de240a-1d86-405b-8f9a-4dd2ef162796', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:55 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5610fb5-55c8-4476-994c-6e912ce7eda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:55 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-98959fd1-e154-407c-a5f4-8e2a433700cc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Creating offline snapshot eb003e91-6234-467b-bb9c-02ca322ab71f of volume 4a181773-c53f-411b-98b3-701ba9898580 {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:20:55 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] Volume volume-f2de240a-1d86-405b-8f9a-4dd2ef162796 (f2de240a-1d86-405b-8f9a-4dd2ef162796): created successfully Jun 29 11:20:55 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5610fb5-55c8-4476-994c-6e912ce7eda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:55 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] Flow 'volume_create_manager' (1f65b1dd-94c6-4c2a-9b6f-863269a27085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:20:55 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb84f138-a21f-49dc-b891-f703f8439551]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:20:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-98959fd1-e154-407c-a5f4-8e2a433700cc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:56 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-e7b4f0bf-4a5a-4f12-8959-e52723e7a5e9 tempest-VolumesListTestJSON-1848553934 None] Created volume successfully. Jun 29 11:20:56 devstack sudo[109042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580 Jun 29 11:20:56 devstack sudo[109042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:56 devstack sudo[109042]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-98959fd1-e154-407c-a5f4-8e2a433700cc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580" returned: 0 in 0.846s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-98959fd1-e154-407c-a5f4-8e2a433700cc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580.eb003e91-6234-467b-bb9c-02ca322ab71f 2G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:56 devstack sudo[109049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580.eb003e91-6234-467b-bb9c-02ca322ab71f 2G Jun 29 11:20:56 devstack sudo[109049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:57 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:20:57 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] Flow 'volume_create_manager' (c934da60-4f67-42dd-90e6-504cec5ff618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:20:57 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50010f7a-e840-437f-ad9c-f39c9ad76183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:57 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50010f7a-e840-437f-ad9c-f39c9ad76183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1267408581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f227ea44-3b83-46f4-8354-f4d205ea8c89,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67d6ce5508d9481ca621d096cde23598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:20:57Z,use_quota=True,user_id='98e0d128e34e401f9723693625cd8526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:57 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f65b464-b16e-4730-bfa6-9624f0eb9c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:57 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f65b464-b16e-4730-bfa6-9624f0eb9c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:57 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c52be4ef-73e0-4ede-ac63-733c963ce27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:57 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c52be4ef-73e0-4ede-ac63-733c963ce27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f227ea44-3b83-46f4-8354-f4d205ea8c89', 'volume_name': 'volume-f227ea44-3b83-46f4-8354-f4d205ea8c89', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:57 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d62d91-89bb-47ac-baeb-e8b5bf2e16b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:57 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d62d91-89bb-47ac-baeb-e8b5bf2e16b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:20:57 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43a68f5a-6359-4423-a63c-9f891e6385c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:20:57 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] Volume f227ea44-3b83-46f4-8354-f4d205ea8c89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f227ea44-3b83-46f4-8354-f4d205ea8c89', 'volume_size': 1} Jun 29 11:20:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:20:57 devstack sudo[109049]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-98959fd1-e154-407c-a5f4-8e2a433700cc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580.eb003e91-6234-467b-bb9c-02ca322ab71f 2G" returned: 0 in 0.930s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-98959fd1-e154-407c-a5f4-8e2a433700cc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a181773-c53f-411b-98b3-701ba9898580 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580.eb003e91-6234-467b-bb9c-02ca322ab71f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:57 devstack sudo[109074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a181773-c53f-411b-98b3-701ba9898580 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580.eb003e91-6234-467b-bb9c-02ca322ab71f Jun 29 11:20:57 devstack sudo[109074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:58 devstack sudo[109074]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-98959fd1-e154-407c-a5f4-8e2a433700cc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a181773-c53f-411b-98b3-701ba9898580 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580.eb003e91-6234-467b-bb9c-02ca322ab71f" returned: 0 in 0.780s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:58 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-98959fd1-e154-407c-a5f4-8e2a433700cc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580.eb003e91-6234-467b-bb9c-02ca322ab71f is being set with open permissions: ugo+rw Jun 29 11:20:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-98959fd1-e154-407c-a5f4-8e2a433700cc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580.eb003e91-6234-467b-bb9c-02ca322ab71f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:58 devstack sudo[109097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580.eb003e91-6234-467b-bb9c-02ca322ab71f Jun 29 11:20:58 devstack sudo[109097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:59 devstack sudo[109097]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-98959fd1-e154-407c-a5f4-8e2a433700cc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580.eb003e91-6234-467b-bb9c-02ca322ab71f" returned: 0 in 0.691s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-98959fd1-e154-407c-a5f4-8e2a433700cc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:20:59 devstack sudo[109101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580.info Jun 29 11:20:59 devstack sudo[109101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:20:59 devstack sudo[109101]: pam_unix(sudo:session): session closed for user root Jun 29 11:20:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-98959fd1-e154-407c-a5f4-8e2a433700cc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580.info" returned: 0 in 0.708s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:20:59 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-98959fd1-e154-407c-a5f4-8e2a433700cc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580.info is being set with open permissions: ugo+rw Jun 29 11:20:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-98959fd1-e154-407c-a5f4-8e2a433700cc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:00 devstack sudo[109105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580.info Jun 29 11:21:00 devstack sudo[109105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:00 devstack sudo[109105]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-98959fd1-e154-407c-a5f4-8e2a433700cc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580.info" returned: 0 in 0.695s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-98959fd1-e154-407c-a5f4-8e2a433700cc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.775s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:21:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.244s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:21:00 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1267408581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f227ea44-3b83-46f4-8354-f4d205ea8c89,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='67d6ce5508d9481ca621d096cde23598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:20:57Z,use_quota=True,user_id='98e0d128e34e401f9723693625cd8526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:21:00 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] Creating volume f227ea44-3b83-46f4-8354-f4d205ea8c89 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:21:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:21:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:21:00 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:21:00 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:21:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:21:00 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:21:00 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:21:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f227ea44-3b83-46f4-8354-f4d205ea8c89 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:00 devstack sudo[109108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f227ea44-3b83-46f4-8354-f4d205ea8c89 1073741824 Jun 29 11:21:00 devstack sudo[109108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:00 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-27c59870-3a82-4afa-81b8-a9c0d14905a6 req-dda70a38-2549-47ba-b9d5-454be20596e3 tempest-TestShelveInstance-569084186 None] Terminate volume connection completed successfully. Jun 29 11:21:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-27c59870-3a82-4afa-81b8-a9c0d14905a6 req-dda70a38-2549-47ba-b9d5-454be20596e3 tempest-TestShelveInstance-569084186 None] Deleting attachment d8ea2512-ad15-42aa-a08c-1ee0fb663062. {{(pid=93497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 11:21:00 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-98959fd1-e154-407c-a5f4-8e2a433700cc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Create snapshot completed successfully Jun 29 11:21:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [req-27c59870-3a82-4afa-81b8-a9c0d14905a6 req-9c5816ea-a972-4f31-aaf6-eacc1a29cc45 tempest-TestShelveInstance-569084186 None] Acquiring lock "cinder-f24ac8fe-816f-4914-b1b7-ca6c2d303819-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:21:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [req-27c59870-3a82-4afa-81b8-a9c0d14905a6 req-9c5816ea-a972-4f31-aaf6-eacc1a29cc45 tempest-TestShelveInstance-569084186 None] Lock "cinder-f24ac8fe-816f-4914-b1b7-ca6c2d303819-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:21:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [req-27c59870-3a82-4afa-81b8-a9c0d14905a6 req-9c5816ea-a972-4f31-aaf6-eacc1a29cc45 tempest-TestShelveInstance-569084186 None] Acquiring lock "cinder-quobyte-f24ac8fe-816f-4914-b1b7-ca6c2d303819" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:21:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [req-27c59870-3a82-4afa-81b8-a9c0d14905a6 req-9c5816ea-a972-4f31-aaf6-eacc1a29cc45 tempest-TestShelveInstance-569084186 None] Lock "cinder-quobyte-f24ac8fe-816f-4914-b1b7-ca6c2d303819" acquired by "delete_volume" :: waited 0.019s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:21:01 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fda04b-d375-432a-9003-156cb70e4107]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:21:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-27c59870-3a82-4afa-81b8-a9c0d14905a6 req-9c5816ea-a972-4f31-aaf6-eacc1a29cc45 tempest-TestShelveInstance-569084186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:01 devstack sudo[109114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819 Jun 29 11:21:01 devstack sudo[109114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:01 devstack sudo[109108]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f227ea44-3b83-46f4-8354-f4d205ea8c89 1073741824" returned: 0 in 0.885s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f227ea44-3b83-46f4-8354-f4d205ea8c89 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:01 devstack sudo[109116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f227ea44-3b83-46f4-8354-f4d205ea8c89 Jun 29 11:21:01 devstack sudo[109116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d7efdd2c-7c38-4eb5-844a-0a4f82b0a8d3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Acquiring lock "cinder-eb003e91-6234-467b-bb9c-02ca322ab71f-delete_snapshot" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:21:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d7efdd2c-7c38-4eb5-844a-0a4f82b0a8d3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Lock "cinder-eb003e91-6234-467b-bb9c-02ca322ab71f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:21:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d7efdd2c-7c38-4eb5-844a-0a4f82b0a8d3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Acquiring lock "cinder-quobyte-4a181773-c53f-411b-98b3-701ba9898580" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:21:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d7efdd2c-7c38-4eb5-844a-0a4f82b0a8d3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Lock "cinder-quobyte-4a181773-c53f-411b-98b3-701ba9898580" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:21:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d7efdd2c-7c38-4eb5-844a-0a4f82b0a8d3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Acquiring lock "cinder-quobyte-eb003e91-6234-467b-bb9c-02ca322ab71f" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:21:02 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d7efdd2c-7c38-4eb5-844a-0a4f82b0a8d3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Lock "cinder-quobyte-eb003e91-6234-467b-bb9c-02ca322ab71f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:21:02 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-d7efdd2c-7c38-4eb5-844a-0a4f82b0a8d3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Deleting offline snapshot eb003e91-6234-467b-bb9c-02ca322ab71f of volume 4a181773-c53f-411b-98b3-701ba9898580 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:21:02 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-d7efdd2c-7c38-4eb5-844a-0a4f82b0a8d3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] snapshot_file for this snap is: volume-4a181773-c53f-411b-98b3-701ba9898580.eb003e91-6234-467b-bb9c-02ca322ab71f {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:21:02 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c459f7e-6c42-4ca5-bbc7-8ced4e62efc3]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:21:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d7efdd2c-7c38-4eb5-844a-0a4f82b0a8d3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580.eb003e91-6234-467b-bb9c-02ca322ab71f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:02 devstack sudo[109118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580.eb003e91-6234-467b-bb9c-02ca322ab71f Jun 29 11:21:02 devstack sudo[109118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:02 devstack sudo[109114]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-27c59870-3a82-4afa-81b8-a9c0d14905a6 req-9c5816ea-a972-4f31-aaf6-eacc1a29cc45 tempest-TestShelveInstance-569084186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819" returned: 0 in 0.824s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-27c59870-3a82-4afa-81b8-a9c0d14905a6 req-9c5816ea-a972-4f31-aaf6-eacc1a29cc45 tempest-TestShelveInstance-569084186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:02 devstack sudo[109116]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f227ea44-3b83-46f4-8354-f4d205ea8c89" returned: 0 in 0.724s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:02 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:21:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:21:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43a68f5a-6359-4423-a63c-9f891e6385c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f227ea44-3b83-46f4-8354-f4d205ea8c89', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bf3b5d6-01ee-4691-a609-99f07521973b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:02 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] Volume volume-f227ea44-3b83-46f4-8354-f4d205ea8c89 (f227ea44-3b83-46f4-8354-f4d205ea8c89): created successfully Jun 29 11:21:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bf3b5d6-01ee-4691-a609-99f07521973b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:02 devstack sudo[109123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819 Jun 29 11:21:02 devstack sudo[109123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] Flow 'volume_create_manager' (c934da60-4f67-42dd-90e6-504cec5ff618) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:21:02 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-2bec141a-02da-466f-8662-2e8fac98db13 tempest-VolumesListTestJSON-1848553934 None] Created volume successfully. Jun 29 11:21:02 devstack sudo[109118]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d7efdd2c-7c38-4eb5-844a-0a4f82b0a8d3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580.eb003e91-6234-467b-bb9c-02ca322ab71f" returned: 0 in 0.814s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:02 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-d7efdd2c-7c38-4eb5-844a-0a4f82b0a8d3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a181773-c53f-411b-98b3-701ba9898580(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:21:02 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2891eeb0-6195-4d9c-bd80-cf988723e26f]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:21:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d7efdd2c-7c38-4eb5-844a-0a4f82b0a8d3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:03 devstack sudo[109131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580 Jun 29 11:21:03 devstack sudo[109131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:03 devstack sudo[109123]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-27c59870-3a82-4afa-81b8-a9c0d14905a6 req-9c5816ea-a972-4f31-aaf6-eacc1a29cc45 tempest-TestShelveInstance-569084186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819" returned: 1 in 0.829s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-27c59870-3a82-4afa-81b8-a9c0d14905a6 req-9c5816ea-a972-4f31-aaf6-eacc1a29cc45 tempest-TestShelveInstance-569084186 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:21:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-27c59870-3a82-4afa-81b8-a9c0d14905a6 req-9c5816ea-a972-4f31-aaf6-eacc1a29cc45 tempest-TestShelveInstance-569084186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:03 devstack sudo[109134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819 Jun 29 11:21:03 devstack sudo[109134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:03 devstack sudo[109131]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d7efdd2c-7c38-4eb5-844a-0a4f82b0a8d3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580" returned: 0 in 0.883s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d7efdd2c-7c38-4eb5-844a-0a4f82b0a8d3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580.eb003e91-6234-467b-bb9c-02ca322ab71f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:03 devstack sudo[109134]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-27c59870-3a82-4afa-81b8-a9c0d14905a6 req-9c5816ea-a972-4f31-aaf6-eacc1a29cc45 tempest-TestShelveInstance-569084186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f24ac8fe-816f-4914-b1b7-ca6c2d303819" returned: 0 in 0.717s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:03 devstack sudo[109140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580.eb003e91-6234-467b-bb9c-02ca322ab71f Jun 29 11:21:03 devstack sudo[109140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [req-27c59870-3a82-4afa-81b8-a9c0d14905a6 req-9c5816ea-a972-4f31-aaf6-eacc1a29cc45 tempest-TestShelveInstance-569084186 None] Lock "cinder-quobyte-f24ac8fe-816f-4914-b1b7-ca6c2d303819" released by "delete_volume" :: held 2.443s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:21:03 devstack cinder-volume[93497]: DEBUG cinder.quota [req-27c59870-3a82-4afa-81b8-a9c0d14905a6 req-9c5816ea-a972-4f31-aaf6-eacc1a29cc45 tempest-TestShelveInstance-569084186 None] Created reservations ['9aeb43ce-077d-484c-bbf5-1f651d916c55', '0aefdde5-c438-4a10-a83b-2022489eb80e', 'f8334a41-96fc-4136-bc5e-6368c0666369', '5b3cb87c-07e5-45bd-92bd-bd75f5ff63f7'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:21:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-27c59870-3a82-4afa-81b8-a9c0d14905a6 req-9c5816ea-a972-4f31-aaf6-eacc1a29cc45 tempest-TestShelveInstance-569084186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:21:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-27c59870-3a82-4afa-81b8-a9c0d14905a6 req-9c5816ea-a972-4f31-aaf6-eacc1a29cc45 tempest-TestShelveInstance-569084186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:21:03 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [req-27c59870-3a82-4afa-81b8-a9c0d14905a6 req-9c5816ea-a972-4f31-aaf6-eacc1a29cc45 tempest-TestShelveInstance-569084186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:21:04 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [req-27c59870-3a82-4afa-81b8-a9c0d14905a6 req-9c5816ea-a972-4f31-aaf6-eacc1a29cc45 tempest-TestShelveInstance-569084186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:21:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-27c59870-3a82-4afa-81b8-a9c0d14905a6 req-9c5816ea-a972-4f31-aaf6-eacc1a29cc45 tempest-TestShelveInstance-569084186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:21:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-27c59870-3a82-4afa-81b8-a9c0d14905a6 req-9c5816ea-a972-4f31-aaf6-eacc1a29cc45 tempest-TestShelveInstance-569084186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:04 devstack sudo[109142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:21:04 devstack sudo[109142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:04 devstack sudo[109140]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d7efdd2c-7c38-4eb5-844a-0a4f82b0a8d3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580.eb003e91-6234-467b-bb9c-02ca322ab71f" returned: 0 in 0.942s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d7efdd2c-7c38-4eb5-844a-0a4f82b0a8d3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580.eb003e91-6234-467b-bb9c-02ca322ab71f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:04 devstack sudo[109149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580.eb003e91-6234-467b-bb9c-02ca322ab71f Jun 29 11:21:04 devstack sudo[109149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:04 devstack sudo[109142]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-27c59870-3a82-4afa-81b8-a9c0d14905a6 req-9c5816ea-a972-4f31-aaf6-eacc1a29cc45 tempest-TestShelveInstance-569084186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.870s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:04 devstack cinder-volume[93497]: DEBUG cinder.manager [req-27c59870-3a82-4afa-81b8-a9c0d14905a6 req-9c5816ea-a972-4f31-aaf6-eacc1a29cc45 tempest-TestShelveInstance-569084186 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:21:04 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-27c59870-3a82-4afa-81b8-a9c0d14905a6 req-9c5816ea-a972-4f31-aaf6-eacc1a29cc45 tempest-TestShelveInstance-569084186 None] Deleted volume successfully. Jun 29 11:21:04 devstack cinder-volume[93497]: DEBUG cinder.coordination [req-27c59870-3a82-4afa-81b8-a9c0d14905a6 req-9c5816ea-a972-4f31-aaf6-eacc1a29cc45 tempest-TestShelveInstance-569084186 None] Lock "cinder-f24ac8fe-816f-4914-b1b7-ca6c2d303819-delete_volume" released by "delete_volume" :: held 3.585s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:21:05 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-96e0332b-2d5e-43dd-8828-0590df849b6b tempest-VolumesListTestJSON-1848553934 None] Acquiring lock "cinder-f227ea44-3b83-46f4-8354-f4d205ea8c89-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:21:05 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-96e0332b-2d5e-43dd-8828-0590df849b6b tempest-VolumesListTestJSON-1848553934 None] Lock "cinder-f227ea44-3b83-46f4-8354-f4d205ea8c89-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:21:05 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-96e0332b-2d5e-43dd-8828-0590df849b6b tempest-VolumesListTestJSON-1848553934 None] Acquiring lock "cinder-quobyte-f227ea44-3b83-46f4-8354-f4d205ea8c89" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:21:05 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-96e0332b-2d5e-43dd-8828-0590df849b6b tempest-VolumesListTestJSON-1848553934 None] Lock "cinder-quobyte-f227ea44-3b83-46f4-8354-f4d205ea8c89" acquired by "delete_volume" :: waited 0.018s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:21:05 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[018e61f6-ff65-4047-a504-24533af9ebe6]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:21:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-96e0332b-2d5e-43dd-8828-0590df849b6b tempest-VolumesListTestJSON-1848553934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f227ea44-3b83-46f4-8354-f4d205ea8c89 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:05 devstack sudo[109151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f227ea44-3b83-46f4-8354-f4d205ea8c89 Jun 29 11:21:05 devstack sudo[109151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:05 devstack sudo[109149]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d7efdd2c-7c38-4eb5-844a-0a4f82b0a8d3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580.eb003e91-6234-467b-bb9c-02ca322ab71f" returned: 0 in 0.772s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:05 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d7efdd2c-7c38-4eb5-844a-0a4f82b0a8d3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Lock "cinder-quobyte-eb003e91-6234-467b-bb9c-02ca322ab71f" released by "_delete_snapshot" :: held 3.596s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:21:05 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d7efdd2c-7c38-4eb5-844a-0a4f82b0a8d3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Lock "cinder-quobyte-4a181773-c53f-411b-98b3-701ba9898580" released by "delete_snapshot" :: held 3.634s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:21:05 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-d7efdd2c-7c38-4eb5-844a-0a4f82b0a8d3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Created reservations ['97750635-4532-46d0-b71e-5f146ea36090', 'ce1f42c5-2e48-4672-886d-f56216d7b904', '96dc8301-3109-4840-b498-4b9fc702c36d', '831743a8-a6ed-42d3-9036-062ed3d84ed4'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:21:05 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-d7efdd2c-7c38-4eb5-844a-0a4f82b0a8d3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Delete snapshot completed successfully. Jun 29 11:21:05 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-d7efdd2c-7c38-4eb5-844a-0a4f82b0a8d3 tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Lock "cinder-eb003e91-6234-467b-bb9c-02ca322ab71f-delete_snapshot" released by "delete_snapshot" :: held 3.775s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:21:06 devstack sudo[109151]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-96e0332b-2d5e-43dd-8828-0590df849b6b tempest-VolumesListTestJSON-1848553934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f227ea44-3b83-46f4-8354-f4d205ea8c89" returned: 0 in 0.834s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-96e0332b-2d5e-43dd-8828-0590df849b6b tempest-VolumesListTestJSON-1848553934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f227ea44-3b83-46f4-8354-f4d205ea8c89 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:06 devstack sudo[109157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f227ea44-3b83-46f4-8354-f4d205ea8c89 Jun 29 11:21:06 devstack sudo[109157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-9c3990c2-75fa-41a5-bfb0-8d152d54d8bc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Acquiring lock "cinder-4a181773-c53f-411b-98b3-701ba9898580-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:21:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-9c3990c2-75fa-41a5-bfb0-8d152d54d8bc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Lock "cinder-4a181773-c53f-411b-98b3-701ba9898580-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:21:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-9c3990c2-75fa-41a5-bfb0-8d152d54d8bc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Acquiring lock "cinder-quobyte-4a181773-c53f-411b-98b3-701ba9898580" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:21:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-9c3990c2-75fa-41a5-bfb0-8d152d54d8bc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Lock "cinder-quobyte-4a181773-c53f-411b-98b3-701ba9898580" acquired by "delete_volume" :: waited 0.029s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:21:06 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c849cb-83e8-490b-ab28-af9decfc1f43]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:21:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9c3990c2-75fa-41a5-bfb0-8d152d54d8bc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:06 devstack sudo[109160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580 Jun 29 11:21:06 devstack sudo[109160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:06 devstack sudo[109157]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-96e0332b-2d5e-43dd-8828-0590df849b6b tempest-VolumesListTestJSON-1848553934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f227ea44-3b83-46f4-8354-f4d205ea8c89" returned: 0 in 0.730s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-96e0332b-2d5e-43dd-8828-0590df849b6b tempest-VolumesListTestJSON-1848553934 None] Lock "cinder-quobyte-f227ea44-3b83-46f4-8354-f4d205ea8c89" released by "delete_volume" :: held 1.614s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:21:06 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-96e0332b-2d5e-43dd-8828-0590df849b6b tempest-VolumesListTestJSON-1848553934 None] Created reservations ['c2006c0b-e398-43f9-a3df-1943b281988b', 'f0ac764a-f5c6-4f02-af6e-dcc617c41847', 'bd3e6280-248d-4b81-8bf0-35ff8d1d31bc', 'c7dd7b10-1c47-46ef-9d2c-0a700bc17a09'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:21:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-96e0332b-2d5e-43dd-8828-0590df849b6b tempest-VolumesListTestJSON-1848553934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:21:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-96e0332b-2d5e-43dd-8828-0590df849b6b tempest-VolumesListTestJSON-1848553934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:21:06 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-96e0332b-2d5e-43dd-8828-0590df849b6b tempest-VolumesListTestJSON-1848553934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:21:06 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-96e0332b-2d5e-43dd-8828-0590df849b6b tempest-VolumesListTestJSON-1848553934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:21:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-96e0332b-2d5e-43dd-8828-0590df849b6b tempest-VolumesListTestJSON-1848553934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:21:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-96e0332b-2d5e-43dd-8828-0590df849b6b tempest-VolumesListTestJSON-1848553934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:07 devstack sudo[109163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:21:07 devstack sudo[109163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:07 devstack sudo[109160]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9c3990c2-75fa-41a5-bfb0-8d152d54d8bc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580" returned: 0 in 0.859s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9c3990c2-75fa-41a5-bfb0-8d152d54d8bc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:07 devstack sudo[109168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580 Jun 29 11:21:07 devstack sudo[109168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:07 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-00c5b421-cb5a-4054-be59-0e00555c6f1c tempest-VolumesListTestJSON-1848553934 None] Acquiring lock "cinder-f2de240a-1d86-405b-8f9a-4dd2ef162796-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:21:07 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-00c5b421-cb5a-4054-be59-0e00555c6f1c tempest-VolumesListTestJSON-1848553934 None] Lock "cinder-f2de240a-1d86-405b-8f9a-4dd2ef162796-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:21:07 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-00c5b421-cb5a-4054-be59-0e00555c6f1c tempest-VolumesListTestJSON-1848553934 None] Acquiring lock "cinder-quobyte-f2de240a-1d86-405b-8f9a-4dd2ef162796" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:21:07 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-00c5b421-cb5a-4054-be59-0e00555c6f1c tempest-VolumesListTestJSON-1848553934 None] Lock "cinder-quobyte-f2de240a-1d86-405b-8f9a-4dd2ef162796" acquired by "delete_volume" :: waited 0.025s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:21:07 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[83dc882c-74f0-4a62-9bb1-a2e7781da1a5]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:21:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-00c5b421-cb5a-4054-be59-0e00555c6f1c tempest-VolumesListTestJSON-1848553934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f2de240a-1d86-405b-8f9a-4dd2ef162796 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:07 devstack sudo[109163]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-96e0332b-2d5e-43dd-8828-0590df849b6b tempest-VolumesListTestJSON-1848553934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.885s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:07 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-96e0332b-2d5e-43dd-8828-0590df849b6b tempest-VolumesListTestJSON-1848553934 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:21:07 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-96e0332b-2d5e-43dd-8828-0590df849b6b tempest-VolumesListTestJSON-1848553934 None] Deleted volume successfully. Jun 29 11:21:07 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-96e0332b-2d5e-43dd-8828-0590df849b6b tempest-VolumesListTestJSON-1848553934 None] Lock "cinder-f227ea44-3b83-46f4-8354-f4d205ea8c89-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:21:07 devstack sudo[109172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f2de240a-1d86-405b-8f9a-4dd2ef162796 Jun 29 11:21:07 devstack sudo[109172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:08 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:21:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:21:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:21:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:21:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:21:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:21:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:08 devstack sudo[109174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:21:08 devstack sudo[109174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:08 devstack sudo[109168]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9c3990c2-75fa-41a5-bfb0-8d152d54d8bc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4a181773-c53f-411b-98b3-701ba9898580" returned: 0 in 0.939s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:08 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-9c3990c2-75fa-41a5-bfb0-8d152d54d8bc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Lock "cinder-quobyte-4a181773-c53f-411b-98b3-701ba9898580" released by "delete_volume" :: held 1.872s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:21:08 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-9c3990c2-75fa-41a5-bfb0-8d152d54d8bc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Created reservations ['a9f87913-0d06-42d9-a9eb-71e3d73691a5', 'b9399def-957f-4330-a6b6-a0eaef298947', '0baada10-43b9-43f7-a2f1-f321cc65f9d1', '24454c93-b348-40e5-acad-a6f1603939b5'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:21:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9c3990c2-75fa-41a5-bfb0-8d152d54d8bc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:21:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9c3990c2-75fa-41a5-bfb0-8d152d54d8bc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:21:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9c3990c2-75fa-41a5-bfb0-8d152d54d8bc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:21:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9c3990c2-75fa-41a5-bfb0-8d152d54d8bc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:21:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9c3990c2-75fa-41a5-bfb0-8d152d54d8bc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:21:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9c3990c2-75fa-41a5-bfb0-8d152d54d8bc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:08 devstack sudo[109178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:21:08 devstack sudo[109178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:08 devstack sudo[109172]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-00c5b421-cb5a-4054-be59-0e00555c6f1c tempest-VolumesListTestJSON-1848553934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f2de240a-1d86-405b-8f9a-4dd2ef162796" returned: 0 in 1.063s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-00c5b421-cb5a-4054-be59-0e00555c6f1c tempest-VolumesListTestJSON-1848553934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f2de240a-1d86-405b-8f9a-4dd2ef162796 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:08 devstack sudo[109184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f2de240a-1d86-405b-8f9a-4dd2ef162796 Jun 29 11:21:08 devstack sudo[109184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:09 devstack sudo[109174]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.124s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:09 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:21:09 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager._thread_info {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:21:09 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread count: 29 {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 11:21:09 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread info: [<_MainThread(MainThread, started 131117520400512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 11:21:09 devstack sudo[109178]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9c3990c2-75fa-41a5-bfb0-8d152d54d8bc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.999s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:09 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-9c3990c2-75fa-41a5-bfb0-8d152d54d8bc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:21:09 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-9c3990c2-75fa-41a5-bfb0-8d152d54d8bc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Deleted volume successfully. Jun 29 11:21:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-9c3990c2-75fa-41a5-bfb0-8d152d54d8bc tempest-VolumesSnapshotNegativeTestJSON-40157326 None] Lock "cinder-4a181773-c53f-411b-98b3-701ba9898580-delete_volume" released by "delete_volume" :: held 3.182s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:21:09 devstack sudo[109184]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-00c5b421-cb5a-4054-be59-0e00555c6f1c tempest-VolumesListTestJSON-1848553934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f2de240a-1d86-405b-8f9a-4dd2ef162796" returned: 0 in 1.007s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-00c5b421-cb5a-4054-be59-0e00555c6f1c tempest-VolumesListTestJSON-1848553934 None] Lock "cinder-quobyte-f2de240a-1d86-405b-8f9a-4dd2ef162796" released by "delete_volume" :: held 2.130s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:21:10 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-00c5b421-cb5a-4054-be59-0e00555c6f1c tempest-VolumesListTestJSON-1848553934 None] Created reservations ['96b257e6-086c-479e-95cc-34db3c428e73', 'fce3622c-71c8-4c43-a06a-e852dabccbb4', 'd4b51f38-88f0-45ef-985c-77fb15df02f4', '216da658-4d20-479a-b0e4-f8ac34bdaab4'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:21:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-00c5b421-cb5a-4054-be59-0e00555c6f1c tempest-VolumesListTestJSON-1848553934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:21:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-00c5b421-cb5a-4054-be59-0e00555c6f1c tempest-VolumesListTestJSON-1848553934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:21:10 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-00c5b421-cb5a-4054-be59-0e00555c6f1c tempest-VolumesListTestJSON-1848553934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:21:10 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-00c5b421-cb5a-4054-be59-0e00555c6f1c tempest-VolumesListTestJSON-1848553934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:21:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-00c5b421-cb5a-4054-be59-0e00555c6f1c tempest-VolumesListTestJSON-1848553934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:21:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-00c5b421-cb5a-4054-be59-0e00555c6f1c tempest-VolumesListTestJSON-1848553934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:10 devstack sudo[109190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:21:10 devstack sudo[109190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:10 devstack sudo[109190]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-00c5b421-cb5a-4054-be59-0e00555c6f1c tempest-VolumesListTestJSON-1848553934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.713s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:10 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-00c5b421-cb5a-4054-be59-0e00555c6f1c tempest-VolumesListTestJSON-1848553934 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:21:10 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-00c5b421-cb5a-4054-be59-0e00555c6f1c tempest-VolumesListTestJSON-1848553934 None] Deleted volume successfully. Jun 29 11:21:10 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-00c5b421-cb5a-4054-be59-0e00555c6f1c tempest-VolumesListTestJSON-1848553934 None] Lock "cinder-f2de240a-1d86-405b-8f9a-4dd2ef162796-delete_volume" released by "delete_volume" :: held 3.161s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:21:11 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2547f0db-95b9-4adc-b3cb-714862959450 tempest-VolumesListTestJSON-1848553934 None] Acquiring lock "cinder-6565da74-eef9-4654-ab3b-56b29e2b8dfa-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:21:11 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2547f0db-95b9-4adc-b3cb-714862959450 tempest-VolumesListTestJSON-1848553934 None] Lock "cinder-6565da74-eef9-4654-ab3b-56b29e2b8dfa-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:21:11 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2547f0db-95b9-4adc-b3cb-714862959450 tempest-VolumesListTestJSON-1848553934 None] Acquiring lock "cinder-quobyte-6565da74-eef9-4654-ab3b-56b29e2b8dfa" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:21:11 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2547f0db-95b9-4adc-b3cb-714862959450 tempest-VolumesListTestJSON-1848553934 None] Lock "cinder-quobyte-6565da74-eef9-4654-ab3b-56b29e2b8dfa" acquired by "delete_volume" :: waited 0.020s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:21:11 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b345d9e9-5012-4677-a3e6-7e692819dc39]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:21:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2547f0db-95b9-4adc-b3cb-714862959450 tempest-VolumesListTestJSON-1848553934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6565da74-eef9-4654-ab3b-56b29e2b8dfa {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:11 devstack sudo[109194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6565da74-eef9-4654-ab3b-56b29e2b8dfa Jun 29 11:21:11 devstack sudo[109194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:12 devstack sudo[109194]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2547f0db-95b9-4adc-b3cb-714862959450 tempest-VolumesListTestJSON-1848553934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6565da74-eef9-4654-ab3b-56b29e2b8dfa" returned: 0 in 0.831s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2547f0db-95b9-4adc-b3cb-714862959450 tempest-VolumesListTestJSON-1848553934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6565da74-eef9-4654-ab3b-56b29e2b8dfa {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:12 devstack sudo[109199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6565da74-eef9-4654-ab3b-56b29e2b8dfa Jun 29 11:21:12 devstack sudo[109199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:12 devstack sudo[109199]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2547f0db-95b9-4adc-b3cb-714862959450 tempest-VolumesListTestJSON-1848553934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-6565da74-eef9-4654-ab3b-56b29e2b8dfa" returned: 0 in 0.834s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:12 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2547f0db-95b9-4adc-b3cb-714862959450 tempest-VolumesListTestJSON-1848553934 None] Lock "cinder-quobyte-6565da74-eef9-4654-ab3b-56b29e2b8dfa" released by "delete_volume" :: held 1.711s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:21:13 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-2547f0db-95b9-4adc-b3cb-714862959450 tempest-VolumesListTestJSON-1848553934 None] Created reservations ['1d04d8bd-3d02-4e15-a55b-056e63f7d5db', '4bc523f2-bfff-413a-906f-756e42856311', '456d486f-71c8-410a-9d88-de7e31899fad', 'bf9554f0-6ca1-4360-92ac-5f3c2e32b9c2'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:21:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2547f0db-95b9-4adc-b3cb-714862959450 tempest-VolumesListTestJSON-1848553934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:21:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2547f0db-95b9-4adc-b3cb-714862959450 tempest-VolumesListTestJSON-1848553934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:21:13 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2547f0db-95b9-4adc-b3cb-714862959450 tempest-VolumesListTestJSON-1848553934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:21:13 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2547f0db-95b9-4adc-b3cb-714862959450 tempest-VolumesListTestJSON-1848553934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:21:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2547f0db-95b9-4adc-b3cb-714862959450 tempest-VolumesListTestJSON-1848553934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:21:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2547f0db-95b9-4adc-b3cb-714862959450 tempest-VolumesListTestJSON-1848553934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:13 devstack sudo[109203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:21:13 devstack sudo[109203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:13 devstack sudo[109203]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2547f0db-95b9-4adc-b3cb-714862959450 tempest-VolumesListTestJSON-1848553934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.766s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:13 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-2547f0db-95b9-4adc-b3cb-714862959450 tempest-VolumesListTestJSON-1848553934 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:21:13 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-2547f0db-95b9-4adc-b3cb-714862959450 tempest-VolumesListTestJSON-1848553934 None] Deleted volume successfully. Jun 29 11:21:14 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2547f0db-95b9-4adc-b3cb-714862959450 tempest-VolumesListTestJSON-1848553934 None] Lock "cinder-6565da74-eef9-4654-ab3b-56b29e2b8dfa-delete_volume" released by "delete_volume" :: held 2.851s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:21:17 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:21:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] Flow 'volume_create_manager' (558ad4c8-b654-4747-b746-ca24b31aa6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:21:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c790096-c680-450f-9fd0-cd101df49794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c790096-c680-450f-9fd0-cd101df49794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2098168888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f142384acd24eaab32c41ec47c14b86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:21:17Z,use_quota=True,user_id='f795381b07c441d29ea6a0a54b960769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a29b2a0c-9011-42d1-b8a9-881a7685888d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a29b2a0c-9011-42d1-b8a9-881a7685888d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (285c7e1c-136f-427d-bf17-d15e750a41d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (285c7e1c-136f-427d-bf17-d15e750a41d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6', 'volume_name': 'volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d541039-d07c-4985-b9b1-b7d53e88fd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d541039-d07c-4985-b9b1-b7d53e88fd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cd13f93-7f60-4594-87fa-713f67ed535c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:17 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] Volume cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6', 'volume_size': 1} Jun 29 11:21:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:21:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:21:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2098168888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f142384acd24eaab32c41ec47c14b86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:21:17Z,use_quota=True,user_id='f795381b07c441d29ea6a0a54b960769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:21:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] Creating volume cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:21:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:21:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:21:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:21:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:21:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:21:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:21:17 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:21:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:17 devstack sudo[109207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6 1073741824 Jun 29 11:21:17 devstack sudo[109207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:18 devstack sudo[109207]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6 1073741824" returned: 0 in 0.999s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:18 devstack sudo[109220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6 Jun 29 11:21:18 devstack sudo[109220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:19 devstack sudo[109220]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6" returned: 0 in 0.696s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:19 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:21:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:21:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cd13f93-7f60-4594-87fa-713f67ed535c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6438c1dd-08c3-4ac5-a3eb-f1aeb70ece27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:19 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] Volume volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6 (cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6): created successfully Jun 29 11:21:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6438c1dd-08c3-4ac5-a3eb-f1aeb70ece27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] Flow 'volume_create_manager' (558ad4c8-b654-4747-b746-ca24b31aa6b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:21:19 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-4f533c4a-4eb6-406a-a697-d86f632bf705 tempest-VolumesSnapshotListTestJSON-529620200 None] Created volume successfully. Jun 29 11:21:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-591fbbb3-1094-498a-841c-6b46ea094793 tempest-VolumesSnapshotListTestJSON-529620200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:21:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-591fbbb3-1094-498a-841c-6b46ea094793 tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:21:20 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-591fbbb3-1094-498a-841c-6b46ea094793 tempest-VolumesSnapshotListTestJSON-529620200 None] Creating offline snapshot 5b232877-5959-4dce-a8dc-873a16eecbaa of volume cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6 {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:21:20 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1f601f-a243-4ca8-9b74-8549c546ec87]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:21:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-591fbbb3-1094-498a-841c-6b46ea094793 tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:20 devstack sudo[109223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6 Jun 29 11:21:20 devstack sudo[109223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:21 devstack sudo[109223]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-591fbbb3-1094-498a-841c-6b46ea094793 tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6" returned: 0 in 0.812s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-591fbbb3-1094-498a-841c-6b46ea094793 tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:21 devstack sudo[109228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa 1G Jun 29 11:21:21 devstack sudo[109228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:21 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:21:21 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Flow 'volume_create_manager' (bf9d4f05-2662-4dac-9fcf-24e413af9571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:21:21 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302c2465-6921-4c37-997c-9a3b036dbf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:21 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302c2465-6921-4c37-997c-9a3b036dbf4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=130eb249-a1bf-4921-8944-68fe478a8f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59953754550642deb44a2259499145d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:21:22Z,use_quota=True,user_id='e8ff97338ab14eebb1dcdecc292530e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8eab2856-160e-4b6c-808f-0412beb22bd0),volume_type_id=8eab2856-160e-4b6c-808f-0412beb22bd0)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:21 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aed20a2-bc81-46fc-96fa-427ac95b3080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:21 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aed20a2-bc81-46fc-96fa-427ac95b3080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:21 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35190011-211f-4000-9a41-96822b223742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:21 devstack cinder-volume[93497]: DEBUG cinder.image.glance [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Creating Keystone auth plugin from conf {{(pid=93497) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 29 11:21:22 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35190011-211f-4000-9a41-96822b223742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '130eb249-a1bf-4921-8944-68fe478a8f2f', 'volume_name': 'volume-130eb249-a1bf-4921-8944-68fe478a8f2f', 'volume_size': 1, 'image_id': 'fa83a397-3ddd-4e96-abff-73f9dd536199', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa83a397-3ddd-4e96-abff-73f9dd536199', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '755b1e50b53e5ce15a36a1ec58aef711', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '59953754550642deb44a2259499145d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '788bb8746ec68672e35a5d881292d5c0c6e3f8db818e2c8aba3b496bd0e0a9ae728e2ebcc6d90bca7b22713de51bd6a39ab771902f7fd6f91e72174dfa17c2f0', 'id': 'fa83a397-3ddd-4e96-abff-73f9dd536199', 'created_at': datetime.datetime(2026, 6, 29, 9, 21, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 9, 21, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa83a397-3ddd-4e96-abff-73f9dd536199/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:22 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5257f7-bf19-4e47-9260-9825c717cf64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:22 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5257f7-bf19-4e47-9260-9825c717cf64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:22 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6447e3e7-c3b0-4d94-bd2a-fec02d70e909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:22 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Volume 130eb249-a1bf-4921-8944-68fe478a8f2f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-130eb249-a1bf-4921-8944-68fe478a8f2f', 'volume_size': 1, 'image_id': 'fa83a397-3ddd-4e96-abff-73f9dd536199', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa83a397-3ddd-4e96-abff-73f9dd536199', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '755b1e50b53e5ce15a36a1ec58aef711', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '59953754550642deb44a2259499145d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '788bb8746ec68672e35a5d881292d5c0c6e3f8db818e2c8aba3b496bd0e0a9ae728e2ebcc6d90bca7b22713de51bd6a39ab771902f7fd6f91e72174dfa17c2f0', 'id': 'fa83a397-3ddd-4e96-abff-73f9dd536199', 'created_at': datetime.datetime(2026, 6, 29, 9, 21, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 9, 21, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa83a397-3ddd-4e96-abff-73f9dd536199/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 29 11:21:22 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Trying to clone 130eb249-a1bf-4921-8944-68fe478a8f2f from image fa83a397-3ddd-4e96-abff-73f9dd536199 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fa83a397-3ddd-4e96-abff-73f9dd536199', 'metadata': {}}]). {{(pid=93497) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 29 11:21:22 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fa83a397-3ddd-4e96-abff-73f9dd536199_4vuogh7bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93497) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 29 11:21:22 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Image download 0.00 MB at 0.00 MB/s Jun 29 11:21:22 devstack sudo[109228]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-591fbbb3-1094-498a-841c-6b46ea094793 tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa 1G" returned: 0 in 0.967s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-591fbbb3-1094-498a-841c-6b46ea094793 tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:22 devstack sudo[109234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa Jun 29 11:21:22 devstack sudo[109234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:22 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[229a91c9-b052-437e-9084-862a34d92736]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:21:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa83a397-3ddd-4e96-abff-73f9dd536199_4vuogh7bdevstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:22 devstack sudo[109236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa83a397-3ddd-4e96-abff-73f9dd536199_4vuogh7bdevstack@QuobyteHD Jun 29 11:21:22 devstack sudo[109236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:23 devstack sudo[109234]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-591fbbb3-1094-498a-841c-6b46ea094793 tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa" returned: 0 in 0.725s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:23 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-591fbbb3-1094-498a-841c-6b46ea094793 tempest-VolumesSnapshotListTestJSON-529620200 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa is being set with open permissions: ugo+rw Jun 29 11:21:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-591fbbb3-1094-498a-841c-6b46ea094793 tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:23 devstack sudo[109243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa Jun 29 11:21:23 devstack sudo[109243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:23 devstack sudo[109236]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa83a397-3ddd-4e96-abff-73f9dd536199_4vuogh7bdevstack@QuobyteHD" returned: 0 in 0.797s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa83a397-3ddd-4e96-abff-73f9dd536199_4vuogh7bdevstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:23 devstack sudo[109245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa83a397-3ddd-4e96-abff-73f9dd536199_4vuogh7bdevstack@QuobyteHD Jun 29 11:21:23 devstack sudo[109245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:23 devstack sudo[109243]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-591fbbb3-1094-498a-841c-6b46ea094793 tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa" returned: 0 in 0.808s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-591fbbb3-1094-498a-841c-6b46ea094793 tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:23 devstack sudo[109248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.info Jun 29 11:21:23 devstack sudo[109248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:24 devstack sudo[109245]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa83a397-3ddd-4e96-abff-73f9dd536199_4vuogh7bdevstack@QuobyteHD" returned: 1 in 0.865s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa83a397-3ddd-4e96-abff-73f9dd536199_4vuogh7bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:21:24 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Temporary image fa83a397-3ddd-4e96-abff-73f9dd536199 is fetched for user e8ff97338ab14eebb1dcdecc292530e9. {{(pid=93497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 29 11:21:24 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[155a043e-61df-4826-98f7-dc68e219710a]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:21:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa83a397-3ddd-4e96-abff-73f9dd536199_4vuogh7bdevstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:24 devstack sudo[109253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa83a397-3ddd-4e96-abff-73f9dd536199_4vuogh7bdevstack@QuobyteHD Jun 29 11:21:24 devstack sudo[109253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:24 devstack sudo[109248]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-591fbbb3-1094-498a-841c-6b46ea094793 tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.info" returned: 0 in 0.729s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:24 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-591fbbb3-1094-498a-841c-6b46ea094793 tempest-VolumesSnapshotListTestJSON-529620200 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.info is being set with open permissions: ugo+rw Jun 29 11:21:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-591fbbb3-1094-498a-841c-6b46ea094793 tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:24 devstack sudo[109256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.info Jun 29 11:21:24 devstack sudo[109256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:24 devstack sudo[109253]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa83a397-3ddd-4e96-abff-73f9dd536199_4vuogh7bdevstack@QuobyteHD" returned: 0 in 0.792s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa83a397-3ddd-4e96-abff-73f9dd536199_4vuogh7bdevstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:25 devstack sudo[109260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa83a397-3ddd-4e96-abff-73f9dd536199_4vuogh7bdevstack@QuobyteHD Jun 29 11:21:25 devstack sudo[109260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:25 devstack sudo[109256]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-591fbbb3-1094-498a-841c-6b46ea094793 tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.info" returned: 0 in 0.735s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-591fbbb3-1094-498a-841c-6b46ea094793 tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.886s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:21:25 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-591fbbb3-1094-498a-841c-6b46ea094793 tempest-VolumesSnapshotListTestJSON-529620200 None] Create snapshot completed successfully Jun 29 11:21:25 devstack sudo[109260]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa83a397-3ddd-4e96-abff-73f9dd536199_4vuogh7bdevstack@QuobyteHD" returned: 1 in 0.806s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa83a397-3ddd-4e96-abff-73f9dd536199_4vuogh7bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:21:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:21:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:21:25 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=130eb249-a1bf-4921-8944-68fe478a8f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59953754550642deb44a2259499145d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:21:22Z,use_quota=True,user_id='e8ff97338ab14eebb1dcdecc292530e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8eab2856-160e-4b6c-808f-0412beb22bd0),volume_type_id=8eab2856-160e-4b6c-808f-0412beb22bd0)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:21:25 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Creating volume 130eb249-a1bf-4921-8944-68fe478a8f2f {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:21:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:21:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:21:25 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:21:25 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:21:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:21:25 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:21:25 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:21:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-130eb249-a1bf-4921-8944-68fe478a8f2f 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:25 devstack sudo[109267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-130eb249-a1bf-4921-8944-68fe478a8f2f 1073741824 Jun 29 11:21:25 devstack sudo[109267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-43ece992-fd1f-4fe6-958d-89eb1fa05857 tempest-VolumesSnapshotListTestJSON-529620200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:21:26 devstack sudo[109267]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-130eb249-a1bf-4921-8944-68fe478a8f2f 1073741824" returned: 0 in 0.903s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-130eb249-a1bf-4921-8944-68fe478a8f2f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:26 devstack sudo[109273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-130eb249-a1bf-4921-8944-68fe478a8f2f Jun 29 11:21:26 devstack sudo[109273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:27 devstack sudo[109273]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-130eb249-a1bf-4921-8944-68fe478a8f2f" returned: 0 in 0.671s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:27 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:21:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:21:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-43ece992-fd1f-4fe6-958d-89eb1fa05857 tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.303s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:21:27 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-43ece992-fd1f-4fe6-958d-89eb1fa05857 tempest-VolumesSnapshotListTestJSON-529620200 None] Creating offline snapshot c1f83cad-5ee0-4596-9f16-e5479b0dbc31 of volume cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6 {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:21:27 devstack cinder-volume[93497]: DEBUG cinder.volume.volume_utils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Attempting download of fa83a397-3ddd-4e96-abff-73f9dd536199 ((None, [{'url': 'file:///opt/stack/data/glance/images/fa83a397-3ddd-4e96-abff-73f9dd536199', 'metadata': {}}])) to volume 130eb249-a1bf-4921-8944-68fe478a8f2f. {{(pid=93497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 29 11:21:27 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa42e42-8f46-4da1-b01e-c317255cd5bd]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:21:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-43ece992-fd1f-4fe6-958d-89eb1fa05857 tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:27 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac5f958-02c2-4b08-ba6c-665085191f34]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:21:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa83a397-3ddd-4e96-abff-73f9dd536199_8e53kffk {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:27 devstack sudo[109276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa Jun 29 11:21:27 devstack sudo[109276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:27 devstack sudo[109278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa83a397-3ddd-4e96-abff-73f9dd536199_8e53kffk Jun 29 11:21:27 devstack sudo[109278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:28 devstack sudo[109276]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-43ece992-fd1f-4fe6-958d-89eb1fa05857 tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa" returned: 0 in 0.836s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:28 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-43ece992-fd1f-4fe6-958d-89eb1fa05857 tempest-VolumesSnapshotListTestJSON-529620200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:21:28 devstack sudo[109278]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-43ece992-fd1f-4fe6-958d-89eb1fa05857 tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa83a397-3ddd-4e96-abff-73f9dd536199_8e53kffk" returned: 0 in 0.806s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa83a397-3ddd-4e96-abff-73f9dd536199_8e53kffk {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:28 devstack sudo[109286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31 1G Jun 29 11:21:28 devstack sudo[109286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:28 devstack sudo[109287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa83a397-3ddd-4e96-abff-73f9dd536199_8e53kffk Jun 29 11:21:28 devstack sudo[109287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:29 devstack sudo[109287]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa83a397-3ddd-4e96-abff-73f9dd536199_8e53kffk" returned: 1 in 0.764s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa83a397-3ddd-4e96-abff-73f9dd536199_8e53kffk' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:21:29 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[298c8dfb-fe96-405e-bb72-8fb903b4d886]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:21:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa83a397-3ddd-4e96-abff-73f9dd536199_4vuogh7bdevstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:29 devstack sudo[109296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa83a397-3ddd-4e96-abff-73f9dd536199_4vuogh7bdevstack@QuobyteHD Jun 29 11:21:29 devstack sudo[109296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:29 devstack sudo[109286]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-43ece992-fd1f-4fe6-958d-89eb1fa05857 tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31 1G" returned: 0 in 1.033s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-43ece992-fd1f-4fe6-958d-89eb1fa05857 tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:29 devstack sudo[109298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31 Jun 29 11:21:29 devstack sudo[109298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:29 devstack sudo[109296]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa83a397-3ddd-4e96-abff-73f9dd536199_4vuogh7bdevstack@QuobyteHD" returned: 0 in 0.931s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa83a397-3ddd-4e96-abff-73f9dd536199_4vuogh7bdevstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:30 devstack sudo[109298]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-43ece992-fd1f-4fe6-958d-89eb1fa05857 tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31" returned: 0 in 0.799s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:30 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-43ece992-fd1f-4fe6-958d-89eb1fa05857 tempest-VolumesSnapshotListTestJSON-529620200 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31 is being set with open permissions: ugo+rw Jun 29 11:21:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-43ece992-fd1f-4fe6-958d-89eb1fa05857 tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:30 devstack sudo[109305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa83a397-3ddd-4e96-abff-73f9dd536199_4vuogh7bdevstack@QuobyteHD Jun 29 11:21:30 devstack sudo[109305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:30 devstack sudo[109306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31 Jun 29 11:21:30 devstack sudo[109306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:30 devstack sudo[109305]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa83a397-3ddd-4e96-abff-73f9dd536199_4vuogh7bdevstack@QuobyteHD" returned: 1 in 0.832s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa83a397-3ddd-4e96-abff-73f9dd536199_4vuogh7bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:21:30 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] fa83a397-3ddd-4e96-abff-73f9dd536199 was raw, converting to raw {{(pid=93497) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 29 11:21:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fa83a397-3ddd-4e96-abff-73f9dd536199_4vuogh7bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-130eb249-a1bf-4921-8944-68fe478a8f2f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:30 devstack sudo[109306]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-43ece992-fd1f-4fe6-958d-89eb1fa05857 tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31" returned: 0 in 0.735s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:30 devstack sudo[109313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fa83a397-3ddd-4e96-abff-73f9dd536199_4vuogh7bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-130eb249-a1bf-4921-8944-68fe478a8f2f Jun 29 11:21:30 devstack sudo[109313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-43ece992-fd1f-4fe6-958d-89eb1fa05857 tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.525s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:21:30 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-43ece992-fd1f-4fe6-958d-89eb1fa05857 tempest-VolumesSnapshotListTestJSON-529620200 None] Create snapshot completed successfully Jun 29 11:21:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-aeaed66d-7892-4560-974b-54ec76cf5d6b tempest-VolumesSnapshotListTestJSON-529620200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:21:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-aeaed66d-7892-4560-974b-54ec76cf5d6b tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:21:31 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-aeaed66d-7892-4560-974b-54ec76cf5d6b tempest-VolumesSnapshotListTestJSON-529620200 None] Creating offline snapshot 08b8a83c-0d1b-4673-8cc3-f1152ecfb26a of volume cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6 {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:21:31 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abaeede-375e-4d97-91a8-9b1c505740ef]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:21:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-aeaed66d-7892-4560-974b-54ec76cf5d6b tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:31 devstack sudo[109318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31 Jun 29 11:21:31 devstack sudo[109318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:31 devstack sudo[109313]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fa83a397-3ddd-4e96-abff-73f9dd536199_4vuogh7bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-130eb249-a1bf-4921-8944-68fe478a8f2f" returned: 0 in 0.998s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:31 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fa83a397-3ddd-4e96-abff-73f9dd536199_4vuogh7bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-130eb249-a1bf-4921-8944-68fe478a8f2f {{(pid=93497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 11:21:31 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Converted 0.00 MB image at 0.00 MB/s Jun 29 11:21:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-130eb249-a1bf-4921-8944-68fe478a8f2f 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:31 devstack sudo[109320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-130eb249-a1bf-4921-8944-68fe478a8f2f 1G Jun 29 11:21:31 devstack sudo[109320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:32 devstack sudo[109318]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-aeaed66d-7892-4560-974b-54ec76cf5d6b tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31" returned: 0 in 0.916s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:32 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-aeaed66d-7892-4560-974b-54ec76cf5d6b tempest-VolumesSnapshotListTestJSON-529620200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:21:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-aeaed66d-7892-4560-974b-54ec76cf5d6b tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.08b8a83c-0d1b-4673-8cc3-f1152ecfb26a 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:32 devstack sudo[109328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.08b8a83c-0d1b-4673-8cc3-f1152ecfb26a 1G Jun 29 11:21:32 devstack sudo[109328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:32 devstack sudo[109320]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-130eb249-a1bf-4921-8944-68fe478a8f2f 1G" returned: 0 in 0.939s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:32 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e0a356-a0d0-4d3e-9845-4d6a0f53703c]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:21:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-130eb249-a1bf-4921-8944-68fe478a8f2f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:32 devstack sudo[109330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-130eb249-a1bf-4921-8944-68fe478a8f2f Jun 29 11:21:32 devstack sudo[109330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:33 devstack sudo[109328]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-aeaed66d-7892-4560-974b-54ec76cf5d6b tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.08b8a83c-0d1b-4673-8cc3-f1152ecfb26a 1G" returned: 0 in 1.016s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-aeaed66d-7892-4560-974b-54ec76cf5d6b tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.08b8a83c-0d1b-4673-8cc3-f1152ecfb26a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:33 devstack sudo[109339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.08b8a83c-0d1b-4673-8cc3-f1152ecfb26a Jun 29 11:21:33 devstack sudo[109339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:33 devstack sudo[109330]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-130eb249-a1bf-4921-8944-68fe478a8f2f" returned: 0 in 1.051s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-130eb249-a1bf-4921-8944-68fe478a8f2f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:34 devstack sudo[109341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-130eb249-a1bf-4921-8944-68fe478a8f2f Jun 29 11:21:34 devstack sudo[109341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:34 devstack sudo[109339]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-aeaed66d-7892-4560-974b-54ec76cf5d6b tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.08b8a83c-0d1b-4673-8cc3-f1152ecfb26a" returned: 0 in 0.917s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:34 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-aeaed66d-7892-4560-974b-54ec76cf5d6b tempest-VolumesSnapshotListTestJSON-529620200 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.08b8a83c-0d1b-4673-8cc3-f1152ecfb26a is being set with open permissions: ugo+rw Jun 29 11:21:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-aeaed66d-7892-4560-974b-54ec76cf5d6b tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.08b8a83c-0d1b-4673-8cc3-f1152ecfb26a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:34 devstack sudo[109346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.08b8a83c-0d1b-4673-8cc3-f1152ecfb26a Jun 29 11:21:34 devstack sudo[109346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:34 devstack sudo[109341]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-130eb249-a1bf-4921-8944-68fe478a8f2f" returned: 1 in 0.896s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-130eb249-a1bf-4921-8944-68fe478a8f2f' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:21:34 devstack cinder-volume[93497]: DEBUG cinder.volume.volume_utils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Downloaded image fa83a397-3ddd-4e96-abff-73f9dd536199 ((None, [{'url': 'file:///opt/stack/data/glance/images/fa83a397-3ddd-4e96-abff-73f9dd536199', 'metadata': {}}])) to volume 130eb249-a1bf-4921-8944-68fe478a8f2f successfully. {{(pid=93497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 29 11:21:34 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Temporary image fa83a397-3ddd-4e96-abff-73f9dd536199 for user e8ff97338ab14eebb1dcdecc292530e9 is deleted. {{(pid=93497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 29 11:21:34 devstack cinder-volume[93497]: DEBUG cinder.volume.volume_utils [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Marking volume 130eb249-a1bf-4921-8944-68fe478a8f2f as bootable. {{(pid=93497) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 29 11:21:34 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Copying metadata from image fa83a397-3ddd-4e96-abff-73f9dd536199 to 130eb249-a1bf-4921-8944-68fe478a8f2f. {{(pid=93497) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 29 11:21:34 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Creating volume glance metadata for volume 130eb249-a1bf-4921-8944-68fe478a8f2f backed by image fa83a397-3ddd-4e96-abff-73f9dd536199 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'fa83a397-3ddd-4e96-abff-73f9dd536199', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '755b1e50b53e5ce15a36a1ec58aef711', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93497) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 29 11:21:34 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6447e3e7-c3b0-4d94-bd2a-fec02d70e909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-130eb249-a1bf-4921-8944-68fe478a8f2f', 'volume_size': 1, 'image_id': 'fa83a397-3ddd-4e96-abff-73f9dd536199', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa83a397-3ddd-4e96-abff-73f9dd536199', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '755b1e50b53e5ce15a36a1ec58aef711', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '59953754550642deb44a2259499145d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '788bb8746ec68672e35a5d881292d5c0c6e3f8db818e2c8aba3b496bd0e0a9ae728e2ebcc6d90bca7b22713de51bd6a39ab771902f7fd6f91e72174dfa17c2f0', 'id': 'fa83a397-3ddd-4e96-abff-73f9dd536199', 'created_at': datetime.datetime(2026, 6, 29, 9, 21, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 9, 21, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa83a397-3ddd-4e96-abff-73f9dd536199/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:34 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d153d72a-3ba2-48ee-8391-efa3178a5113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:34 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Volume volume-130eb249-a1bf-4921-8944-68fe478a8f2f (130eb249-a1bf-4921-8944-68fe478a8f2f): created successfully Jun 29 11:21:34 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d153d72a-3ba2-48ee-8391-efa3178a5113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:34 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Flow 'volume_create_manager' (bf9d4f05-2662-4dac-9fcf-24e413af9571) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:21:34 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-22cc102d-c628-4fd4-88a7-f5f0533d7d26 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Created volume successfully. Jun 29 11:21:34 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Flow 'volume_create_manager' (0f9da15f-b02f-43d3-83d2-00fc892d9e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53880c9d-14c9-4346-8f84-c31edf107c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53880c9d-14c9-4346-8f84-c31edf107c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-695249690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0913dc7f-b014-4992-a11c-46b8eab6c8a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d460cfd71a854bac81dd058c7212037b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:21:35Z,use_quota=True,user_id='0be3fe6f3eaa4d8fb1ec98138426c0e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad75faf-a889-41fc-a4d5-0ceeba248e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad75faf-a889-41fc-a4d5-0ceeba248e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd9c26e-1c62-4258-8b35-1b98ee869efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd9c26e-1c62-4258-8b35-1b98ee869efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0913dc7f-b014-4992-a11c-46b8eab6c8a7', 'volume_name': 'volume-0913dc7f-b014-4992-a11c-46b8eab6c8a7', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb43670-ef2b-493d-bf42-f987cb232777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb43670-ef2b-493d-bf42-f987cb232777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e18da3-4322-490c-b737-e7e51c654d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:35 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Volume 0913dc7f-b014-4992-a11c-46b8eab6c8a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0913dc7f-b014-4992-a11c-46b8eab6c8a7', 'volume_size': 1} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:21:35 devstack sudo[109346]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-aeaed66d-7892-4560-974b-54ec76cf5d6b tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.08b8a83c-0d1b-4673-8cc3-f1152ecfb26a" returned: 0 in 0.783s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-aeaed66d-7892-4560-974b-54ec76cf5d6b tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.783s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.281s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-695249690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0913dc7f-b014-4992-a11c-46b8eab6c8a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d460cfd71a854bac81dd058c7212037b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:21:35Z,use_quota=True,user_id='0be3fe6f3eaa4d8fb1ec98138426c0e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Creating volume 0913dc7f-b014-4992-a11c-46b8eab6c8a7 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:21:35 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0913dc7f-b014-4992-a11c-46b8eab6c8a7 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:35 devstack sudo[109352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0913dc7f-b014-4992-a11c-46b8eab6c8a7 1073741824 Jun 29 11:21:35 devstack sudo[109352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:35 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-aeaed66d-7892-4560-974b-54ec76cf5d6b tempest-VolumesSnapshotListTestJSON-529620200 None] Create snapshot completed successfully Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] Flow 'volume_create_manager' (136666bd-ba31-43be-8cd3-e80344c43555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832b22d1-a80a-4327-809b-c85ebe0248e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832b22d1-a80a-4327-809b-c85ebe0248e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1604216637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51fa0053-0bb7-4b8d-b5d9-15987acd5845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d460cfd71a854bac81dd058c7212037b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:21:35Z,use_quota=True,user_id='0be3fe6f3eaa4d8fb1ec98138426c0e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c853fcb7-c6a9-43b5-bce4-4b443fa51e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c853fcb7-c6a9-43b5-bce4-4b443fa51e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118f9b53-93eb-4974-b068-73a5505abff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118f9b53-93eb-4974-b068-73a5505abff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51fa0053-0bb7-4b8d-b5d9-15987acd5845', 'volume_name': 'volume-51fa0053-0bb7-4b8d-b5d9-15987acd5845', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb43364-d958-4fa5-9d4a-6a7bb8e9713d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb43364-d958-4fa5-9d4a-6a7bb8e9713d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25385168-1769-45cc-aa83-22e6692acf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:35 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] Volume 51fa0053-0bb7-4b8d-b5d9-15987acd5845: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51fa0053-0bb7-4b8d-b5d9-15987acd5845', 'volume_size': 1} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f9e62f8f-5be0-4319-95fb-4799a987bd28 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Acquiring lock "cinder-130eb249-a1bf-4921-8944-68fe478a8f2f-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:21:35 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f9e62f8f-5be0-4319-95fb-4799a987bd28 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Lock "cinder-130eb249-a1bf-4921-8944-68fe478a8f2f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:21:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f9e62f8f-5be0-4319-95fb-4799a987bd28 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Acquiring lock "cinder-quobyte-130eb249-a1bf-4921-8944-68fe478a8f2f" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:21:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f9e62f8f-5be0-4319-95fb-4799a987bd28 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Lock "cinder-quobyte-130eb249-a1bf-4921-8944-68fe478a8f2f" acquired by "delete_volume" :: waited 0.025s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:21:36 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e6a4a4-d265-402a-a696-2949f799641b]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:21:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f9e62f8f-5be0-4319-95fb-4799a987bd28 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-130eb249-a1bf-4921-8944-68fe478a8f2f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:36 devstack sudo[109357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-130eb249-a1bf-4921-8944-68fe478a8f2f Jun 29 11:21:36 devstack sudo[109357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:36 devstack sudo[109352]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0913dc7f-b014-4992-a11c-46b8eab6c8a7 1073741824" returned: 0 in 1.141s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0913dc7f-b014-4992-a11c-46b8eab6c8a7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:36 devstack sudo[109360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0913dc7f-b014-4992-a11c-46b8eab6c8a7 Jun 29 11:21:36 devstack sudo[109360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-207d337f-55a1-4bb1-9d5b-6da4617615d7 tempest-VolumesSnapshotListTestJSON-529620200 None] Acquiring lock "cinder-08b8a83c-0d1b-4673-8cc3-f1152ecfb26a-delete_snapshot" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:21:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-207d337f-55a1-4bb1-9d5b-6da4617615d7 tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "cinder-08b8a83c-0d1b-4673-8cc3-f1152ecfb26a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:21:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-207d337f-55a1-4bb1-9d5b-6da4617615d7 tempest-VolumesSnapshotListTestJSON-529620200 None] Acquiring lock "cinder-quobyte-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:21:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-207d337f-55a1-4bb1-9d5b-6da4617615d7 tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "cinder-quobyte-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:21:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-207d337f-55a1-4bb1-9d5b-6da4617615d7 tempest-VolumesSnapshotListTestJSON-529620200 None] Acquiring lock "cinder-quobyte-08b8a83c-0d1b-4673-8cc3-f1152ecfb26a" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:21:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-207d337f-55a1-4bb1-9d5b-6da4617615d7 tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "cinder-quobyte-08b8a83c-0d1b-4673-8cc3-f1152ecfb26a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:21:36 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-207d337f-55a1-4bb1-9d5b-6da4617615d7 tempest-VolumesSnapshotListTestJSON-529620200 None] Deleting offline snapshot 08b8a83c-0d1b-4673-8cc3-f1152ecfb26a of volume cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:21:36 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-207d337f-55a1-4bb1-9d5b-6da4617615d7 tempest-VolumesSnapshotListTestJSON-529620200 None] snapshot_file for this snap is: volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.08b8a83c-0d1b-4673-8cc3-f1152ecfb26a {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:21:37 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae5cfcd-7865-4099-b26b-5ed3c28c5dd2]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:21:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-207d337f-55a1-4bb1-9d5b-6da4617615d7 tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.08b8a83c-0d1b-4673-8cc3-f1152ecfb26a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:37 devstack sudo[109357]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f9e62f8f-5be0-4319-95fb-4799a987bd28 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-130eb249-a1bf-4921-8944-68fe478a8f2f" returned: 0 in 0.970s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f9e62f8f-5be0-4319-95fb-4799a987bd28 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-130eb249-a1bf-4921-8944-68fe478a8f2f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:37 devstack sudo[109364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.08b8a83c-0d1b-4673-8cc3-f1152ecfb26a Jun 29 11:21:37 devstack sudo[109364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:37 devstack sudo[109365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-130eb249-a1bf-4921-8944-68fe478a8f2f Jun 29 11:21:37 devstack sudo[109365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:37 devstack sudo[109360]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0913dc7f-b014-4992-a11c-46b8eab6c8a7" returned: 0 in 0.822s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:37 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] <== create_volume: return (2017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:21:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.022s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:21:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.866s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:21:37 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1604216637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51fa0053-0bb7-4b8d-b5d9-15987acd5845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d460cfd71a854bac81dd058c7212037b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:21:35Z,use_quota=True,user_id='0be3fe6f3eaa4d8fb1ec98138426c0e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:21:37 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] Creating volume 51fa0053-0bb7-4b8d-b5d9-15987acd5845 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:21:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:21:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:21:37 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:21:37 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:21:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:21:37 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:21:37 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:21:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-51fa0053-0bb7-4b8d-b5d9-15987acd5845 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:37 devstack sudo[109369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-51fa0053-0bb7-4b8d-b5d9-15987acd5845 1073741824 Jun 29 11:21:37 devstack sudo[109369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:37 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e18da3-4322-490c-b737-e7e51c654d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0913dc7f-b014-4992-a11c-46b8eab6c8a7', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:37 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c8ce41-bba4-43a7-86ae-90316fa3fb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:37 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Volume volume-0913dc7f-b014-4992-a11c-46b8eab6c8a7 (0913dc7f-b014-4992-a11c-46b8eab6c8a7): created successfully Jun 29 11:21:37 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c8ce41-bba4-43a7-86ae-90316fa3fb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:37 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Flow 'volume_create_manager' (0f9da15f-b02f-43d3-83d2-00fc892d9e0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:21:37 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-e0792fe4-2563-4f10-ad61-5827e72d5292 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Created volume successfully. Jun 29 11:21:38 devstack sudo[109364]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-207d337f-55a1-4bb1-9d5b-6da4617615d7 tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.08b8a83c-0d1b-4673-8cc3-f1152ecfb26a" returned: 0 in 1.008s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:38 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-207d337f-55a1-4bb1-9d5b-6da4617615d7 tempest-VolumesSnapshotListTestJSON-529620200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:21:38 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac65151-4eaa-4eb8-aab1-88c383dd0f8e]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:21:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-207d337f-55a1-4bb1-9d5b-6da4617615d7 tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:38 devstack sudo[109365]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f9e62f8f-5be0-4319-95fb-4799a987bd28 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-130eb249-a1bf-4921-8944-68fe478a8f2f" returned: 1 in 1.012s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f9e62f8f-5be0-4319-95fb-4799a987bd28 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-130eb249-a1bf-4921-8944-68fe478a8f2f' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:21:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f9e62f8f-5be0-4319-95fb-4799a987bd28 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-130eb249-a1bf-4921-8944-68fe478a8f2f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:38 devstack sudo[109383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-130eb249-a1bf-4921-8944-68fe478a8f2f Jun 29 11:21:38 devstack sudo[109383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:38 devstack sudo[109381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31 Jun 29 11:21:38 devstack sudo[109381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:38 devstack sudo[109369]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-51fa0053-0bb7-4b8d-b5d9-15987acd5845 1073741824" returned: 0 in 1.004s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-51fa0053-0bb7-4b8d-b5d9-15987acd5845 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:38 devstack sudo[109387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-51fa0053-0bb7-4b8d-b5d9-15987acd5845 Jun 29 11:21:38 devstack sudo[109387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:38 devstack sudo[109383]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f9e62f8f-5be0-4319-95fb-4799a987bd28 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-130eb249-a1bf-4921-8944-68fe478a8f2f" returned: 0 in 0.749s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:38 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f9e62f8f-5be0-4319-95fb-4799a987bd28 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Lock "cinder-quobyte-130eb249-a1bf-4921-8944-68fe478a8f2f" released by "delete_volume" :: held 2.847s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:21:38 devstack sudo[109381]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-207d337f-55a1-4bb1-9d5b-6da4617615d7 tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31" returned: 0 in 0.870s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:38 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-207d337f-55a1-4bb1-9d5b-6da4617615d7 tempest-VolumesSnapshotListTestJSON-529620200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:21:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-207d337f-55a1-4bb1-9d5b-6da4617615d7 tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.08b8a83c-0d1b-4673-8cc3-f1152ecfb26a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:38 devstack sudo[109394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.08b8a83c-0d1b-4673-8cc3-f1152ecfb26a Jun 29 11:21:38 devstack sudo[109394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:38 devstack cinder-volume[93497]: WARNING cinder.quota [None req-f9e62f8f-5be0-4319-95fb-4799a987bd28 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:21:38 devstack cinder-volume[93497]: WARNING cinder.quota [None req-f9e62f8f-5be0-4319-95fb-4799a987bd28 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 29 11:21:38 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-f9e62f8f-5be0-4319-95fb-4799a987bd28 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Created reservations ['ba330d74-87b1-4265-978c-a5a0f63442ec', 'dcdd4285-7555-4ae6-94ae-bbf6a0ddf902', 'da79e190-9403-4d0a-b03e-8c99016909d1', '9cba4481-7187-4370-a2bc-f3f396482df2'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:21:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f9e62f8f-5be0-4319-95fb-4799a987bd28 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:21:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f9e62f8f-5be0-4319-95fb-4799a987bd28 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:21:39 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f9e62f8f-5be0-4319-95fb-4799a987bd28 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:21:39 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f9e62f8f-5be0-4319-95fb-4799a987bd28 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:21:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f9e62f8f-5be0-4319-95fb-4799a987bd28 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:21:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f9e62f8f-5be0-4319-95fb-4799a987bd28 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:39 devstack sudo[109397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:21:39 devstack sudo[109397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:39 devstack sudo[109387]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-51fa0053-0bb7-4b8d-b5d9-15987acd5845" returned: 0 in 0.775s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:39 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:21:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:21:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25385168-1769-45cc-aa83-22e6692acf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51fa0053-0bb7-4b8d-b5d9-15987acd5845', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07241012-9ff3-4b05-a0e1-c8c06bd1d6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:39 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] Volume volume-51fa0053-0bb7-4b8d-b5d9-15987acd5845 (51fa0053-0bb7-4b8d-b5d9-15987acd5845): created successfully Jun 29 11:21:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07241012-9ff3-4b05-a0e1-c8c06bd1d6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] Flow 'volume_create_manager' (136666bd-ba31-43be-8cd3-e80344c43555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:21:39 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-a9a49c44-e446-48a3-bbd0-ec7c9bdee8ec tempest-TestServerVolumeAttachmentScenario-1545034146 None] Created volume successfully. Jun 29 11:21:40 devstack sudo[109397]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f9e62f8f-5be0-4319-95fb-4799a987bd28 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.956s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:40 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-f9e62f8f-5be0-4319-95fb-4799a987bd28 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:21:40 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-f9e62f8f-5be0-4319-95fb-4799a987bd28 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Deleted volume successfully. Jun 29 11:21:40 devstack sudo[109394]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:40 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f9e62f8f-5be0-4319-95fb-4799a987bd28 tempest-VolumeAndVolumeTypeFromImageTest-836010701 None] Lock "cinder-130eb249-a1bf-4921-8944-68fe478a8f2f-delete_volume" released by "delete_volume" :: held 4.099s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:21:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-207d337f-55a1-4bb1-9d5b-6da4617615d7 tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.08b8a83c-0d1b-4673-8cc3-f1152ecfb26a" returned: 0 in 1.155s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-207d337f-55a1-4bb1-9d5b-6da4617615d7 tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.08b8a83c-0d1b-4673-8cc3-f1152ecfb26a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:40 devstack sudo[109404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.08b8a83c-0d1b-4673-8cc3-f1152ecfb26a Jun 29 11:21:40 devstack sudo[109404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:40 devstack sudo[109404]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-207d337f-55a1-4bb1-9d5b-6da4617615d7 tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.08b8a83c-0d1b-4673-8cc3-f1152ecfb26a" returned: 0 in 0.696s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:40 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-207d337f-55a1-4bb1-9d5b-6da4617615d7 tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "cinder-quobyte-08b8a83c-0d1b-4673-8cc3-f1152ecfb26a" released by "_delete_snapshot" :: held 3.849s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:21:40 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-207d337f-55a1-4bb1-9d5b-6da4617615d7 tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "cinder-quobyte-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6" released by "delete_snapshot" :: held 3.882s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:21:40 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-207d337f-55a1-4bb1-9d5b-6da4617615d7 tempest-VolumesSnapshotListTestJSON-529620200 None] Created reservations ['c8058aef-55bc-4f50-99d5-d899ae9ec2bb', '33c86d82-0252-4e92-baf8-249ec068ec95', '362d7c3a-33bf-4065-8ef0-adc2fb5b87ad', '11836adf-7aba-4a73-b6b4-7f3f039ec07a'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:21:40 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-207d337f-55a1-4bb1-9d5b-6da4617615d7 tempest-VolumesSnapshotListTestJSON-529620200 None] Delete snapshot completed successfully. Jun 29 11:21:40 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-207d337f-55a1-4bb1-9d5b-6da4617615d7 tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "cinder-08b8a83c-0d1b-4673-8cc3-f1152ecfb26a-delete_snapshot" released by "delete_snapshot" :: held 4.084s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:21:41 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-36546b89-9033-4c18-8f79-d534f85681d8 tempest-VolumesSnapshotListTestJSON-529620200 None] Acquiring lock "cinder-c1f83cad-5ee0-4596-9f16-e5479b0dbc31-delete_snapshot" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:21:41 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-36546b89-9033-4c18-8f79-d534f85681d8 tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "cinder-c1f83cad-5ee0-4596-9f16-e5479b0dbc31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:21:41 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-36546b89-9033-4c18-8f79-d534f85681d8 tempest-VolumesSnapshotListTestJSON-529620200 None] Acquiring lock "cinder-quobyte-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:21:41 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-36546b89-9033-4c18-8f79-d534f85681d8 tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "cinder-quobyte-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:21:41 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-36546b89-9033-4c18-8f79-d534f85681d8 tempest-VolumesSnapshotListTestJSON-529620200 None] Acquiring lock "cinder-quobyte-c1f83cad-5ee0-4596-9f16-e5479b0dbc31" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:21:41 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-36546b89-9033-4c18-8f79-d534f85681d8 tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "cinder-quobyte-c1f83cad-5ee0-4596-9f16-e5479b0dbc31" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:21:41 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-36546b89-9033-4c18-8f79-d534f85681d8 tempest-VolumesSnapshotListTestJSON-529620200 None] Deleting offline snapshot c1f83cad-5ee0-4596-9f16-e5479b0dbc31 of volume cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:21:41 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-36546b89-9033-4c18-8f79-d534f85681d8 tempest-VolumesSnapshotListTestJSON-529620200 None] snapshot_file for this snap is: volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:21:41 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ca17b8-9a2a-414b-bc0d-91f41ea68668]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:21:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-36546b89-9033-4c18-8f79-d534f85681d8 tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:41 devstack sudo[109407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31 Jun 29 11:21:41 devstack sudo[109407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:42 devstack sudo[109407]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-36546b89-9033-4c18-8f79-d534f85681d8 tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31" returned: 0 in 0.802s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:42 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-36546b89-9033-4c18-8f79-d534f85681d8 tempest-VolumesSnapshotListTestJSON-529620200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:21:42 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8366d3-d83b-4749-8ced-a131497f8f84]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:21:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-36546b89-9033-4c18-8f79-d534f85681d8 tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:42 devstack sudo[109417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa Jun 29 11:21:42 devstack sudo[109417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:42 devstack sudo[109417]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-36546b89-9033-4c18-8f79-d534f85681d8 tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa" returned: 0 in 0.830s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:42 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-36546b89-9033-4c18-8f79-d534f85681d8 tempest-VolumesSnapshotListTestJSON-529620200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:21:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-36546b89-9033-4c18-8f79-d534f85681d8 tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:43 devstack sudo[109422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31 Jun 29 11:21:43 devstack sudo[109422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:43 devstack sudo[109422]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-36546b89-9033-4c18-8f79-d534f85681d8 tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31" returned: 0 in 0.900s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-36546b89-9033-4c18-8f79-d534f85681d8 tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:43 devstack sudo[109428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31 Jun 29 11:21:43 devstack sudo[109428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:44 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=97,cinder:INSERT=32,cinder:UPDATE=104,cinder:DELETE=11 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:21:44 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:INSERT=34,cinder:UPDATE=127,cinder:SELECT=84,cinder:DELETE=10 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:21:44 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:21:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] Flow 'volume_create_manager' (05846a69-f5be-48af-9580-c0ddeec1fb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:21:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7fb9e9b-6e20-460f-8ba7-92dfc62044ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7fb9e9b-6e20-460f-8ba7-92dfc62044ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-332975821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665397b0-af62-40e8-af6c-b2c0a869bce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3d55be2b8094b989fd52467eebb6263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:21:44Z,use_quota=True,user_id='f1038dba93984e0c8e166ea45c00ca28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b574660-add5-43d4-88d8-7a6ddd8c7120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b574660-add5-43d4-88d8-7a6ddd8c7120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3bac7c3-0705-4158-83c6-36224ac2b9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3bac7c3-0705-4158-83c6-36224ac2b9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '665397b0-af62-40e8-af6c-b2c0a869bce7', 'volume_name': 'volume-665397b0-af62-40e8-af6c-b2c0a869bce7', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37b278a-ab11-4c71-a1d2-ca56c652c264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37b278a-ab11-4c71-a1d2-ca56c652c264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d7b7cf9-fd0e-44ec-93fb-6032205a6edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:44 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] Volume 665397b0-af62-40e8-af6c-b2c0a869bce7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-665397b0-af62-40e8-af6c-b2c0a869bce7', 'volume_size': 1} Jun 29 11:21:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:21:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:21:44 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-332975821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=665397b0-af62-40e8-af6c-b2c0a869bce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3d55be2b8094b989fd52467eebb6263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:21:44Z,use_quota=True,user_id='f1038dba93984e0c8e166ea45c00ca28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:21:44 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] Creating volume 665397b0-af62-40e8-af6c-b2c0a869bce7 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:21:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:21:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:21:44 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:21:44 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:21:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:21:44 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:21:44 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:21:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:44 devstack sudo[109430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7 1073741824 Jun 29 11:21:44 devstack sudo[109430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:44 devstack sudo[109428]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-36546b89-9033-4c18-8f79-d534f85681d8 tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.c1f83cad-5ee0-4596-9f16-e5479b0dbc31" returned: 0 in 0.761s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:44 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-36546b89-9033-4c18-8f79-d534f85681d8 tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "cinder-quobyte-c1f83cad-5ee0-4596-9f16-e5479b0dbc31" released by "_delete_snapshot" :: held 3.421s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:21:44 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-36546b89-9033-4c18-8f79-d534f85681d8 tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "cinder-quobyte-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6" released by "delete_snapshot" :: held 3.457s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:21:44 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-36546b89-9033-4c18-8f79-d534f85681d8 tempest-VolumesSnapshotListTestJSON-529620200 None] Created reservations ['976dd2a5-4ad7-4166-9506-065417ceaef7', 'b058c7ed-e224-4481-958c-ecff35c6ef8f', '51ca2154-ef53-46e7-84f7-20c2a5821f9f', '16abe951-da0f-4a01-8c01-3b3af4c49546'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:21:44 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-36546b89-9033-4c18-8f79-d534f85681d8 tempest-VolumesSnapshotListTestJSON-529620200 None] Delete snapshot completed successfully. Jun 29 11:21:44 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-36546b89-9033-4c18-8f79-d534f85681d8 tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "cinder-c1f83cad-5ee0-4596-9f16-e5479b0dbc31-delete_snapshot" released by "delete_snapshot" :: held 3.668s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:21:45 devstack sudo[109430]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7 1073741824" returned: 0 in 0.959s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:45 devstack sudo[109437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7 Jun 29 11:21:45 devstack sudo[109437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:45 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b34bd7a7-2f96-4d68-8efa-5e8cc7229aba tempest-VolumesSnapshotListTestJSON-529620200 None] Acquiring lock "cinder-5b232877-5959-4dce-a8dc-873a16eecbaa-delete_snapshot" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:21:45 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b34bd7a7-2f96-4d68-8efa-5e8cc7229aba tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "cinder-5b232877-5959-4dce-a8dc-873a16eecbaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:21:45 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b34bd7a7-2f96-4d68-8efa-5e8cc7229aba tempest-VolumesSnapshotListTestJSON-529620200 None] Acquiring lock "cinder-quobyte-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:21:45 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b34bd7a7-2f96-4d68-8efa-5e8cc7229aba tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "cinder-quobyte-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:21:45 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b34bd7a7-2f96-4d68-8efa-5e8cc7229aba tempest-VolumesSnapshotListTestJSON-529620200 None] Acquiring lock "cinder-quobyte-5b232877-5959-4dce-a8dc-873a16eecbaa" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:21:45 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b34bd7a7-2f96-4d68-8efa-5e8cc7229aba tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "cinder-quobyte-5b232877-5959-4dce-a8dc-873a16eecbaa" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:21:45 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-b34bd7a7-2f96-4d68-8efa-5e8cc7229aba tempest-VolumesSnapshotListTestJSON-529620200 None] Deleting offline snapshot 5b232877-5959-4dce-a8dc-873a16eecbaa of volume cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:21:45 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-b34bd7a7-2f96-4d68-8efa-5e8cc7229aba tempest-VolumesSnapshotListTestJSON-529620200 None] snapshot_file for this snap is: volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:21:45 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32a4845-5a84-4693-a157-8687870e5267]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:21:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b34bd7a7-2f96-4d68-8efa-5e8cc7229aba tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:45 devstack sudo[109439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa Jun 29 11:21:45 devstack sudo[109439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:46 devstack sudo[109437]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7" returned: 0 in 0.820s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:21:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:21:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d7b7cf9-fd0e-44ec-93fb-6032205a6edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-665397b0-af62-40e8-af6c-b2c0a869bce7', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a19ca28-4eb4-44ee-8db4-0aa32b08938e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:46 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] Volume volume-665397b0-af62-40e8-af6c-b2c0a869bce7 (665397b0-af62-40e8-af6c-b2c0a869bce7): created successfully Jun 29 11:21:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a19ca28-4eb4-44ee-8db4-0aa32b08938e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] Flow 'volume_create_manager' (05846a69-f5be-48af-9580-c0ddeec1fb8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:21:46 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-0b1dee4c-37cf-4167-bd0c-727890180612 tempest-VolumeDependencyTests-1705073832 None] Created volume successfully. Jun 29 11:21:46 devstack sudo[109439]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b34bd7a7-2f96-4d68-8efa-5e8cc7229aba tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa" returned: 0 in 0.885s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-b34bd7a7-2f96-4d68-8efa-5e8cc7229aba tempest-VolumesSnapshotListTestJSON-529620200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:21:46 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ca63d0-1ceb-4be5-8c18-351c8a12d565]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:21:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b34bd7a7-2f96-4d68-8efa-5e8cc7229aba tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ce9f688c-0dd7-4b1b-8095-745fa740859c tempest-VolumeDependencyTests-1705073832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:21:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ce9f688c-0dd7-4b1b-8095-745fa740859c tempest-VolumeDependencyTests-1705073832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:21:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-ce9f688c-0dd7-4b1b-8095-745fa740859c tempest-VolumeDependencyTests-1705073832 None] Creating offline snapshot 7aa981e1-9dd1-41ae-a39e-334a1cc06c41 of volume 665397b0-af62-40e8-af6c-b2c0a869bce7 {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:21:46 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1280efc1-479c-4111-8282-161702120da1]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:21:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ce9f688c-0dd7-4b1b-8095-745fa740859c tempest-VolumeDependencyTests-1705073832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:46 devstack sudo[109463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6 Jun 29 11:21:46 devstack sudo[109463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:46 devstack sudo[109464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7 Jun 29 11:21:46 devstack sudo[109464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:47 devstack sudo[109463]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:47 devstack sudo[109464]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b34bd7a7-2f96-4d68-8efa-5e8cc7229aba tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6" returned: 0 in 0.822s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b34bd7a7-2f96-4d68-8efa-5e8cc7229aba tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ce9f688c-0dd7-4b1b-8095-745fa740859c tempest-VolumeDependencyTests-1705073832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7" returned: 0 in 0.749s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ce9f688c-0dd7-4b1b-8095-745fa740859c tempest-VolumeDependencyTests-1705073832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7.7aa981e1-9dd1-41ae-a39e-334a1cc06c41 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:47 devstack sudo[109473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa Jun 29 11:21:47 devstack sudo[109473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:47 devstack sudo[109474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7.7aa981e1-9dd1-41ae-a39e-334a1cc06c41 1G Jun 29 11:21:47 devstack sudo[109474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:48 devstack sudo[109473]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b34bd7a7-2f96-4d68-8efa-5e8cc7229aba tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa" returned: 0 in 0.801s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b34bd7a7-2f96-4d68-8efa-5e8cc7229aba tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:48 devstack sudo[109487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa Jun 29 11:21:48 devstack sudo[109487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:48 devstack sudo[109474]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ce9f688c-0dd7-4b1b-8095-745fa740859c tempest-VolumeDependencyTests-1705073832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7.7aa981e1-9dd1-41ae-a39e-334a1cc06c41 1G" returned: 0 in 0.822s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ce9f688c-0dd7-4b1b-8095-745fa740859c tempest-VolumeDependencyTests-1705073832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-665397b0-af62-40e8-af6c-b2c0a869bce7 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7.7aa981e1-9dd1-41ae-a39e-334a1cc06c41 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:48 devstack sudo[109489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-665397b0-af62-40e8-af6c-b2c0a869bce7 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7.7aa981e1-9dd1-41ae-a39e-334a1cc06c41 Jun 29 11:21:48 devstack sudo[109489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:48 devstack sudo[109487]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b34bd7a7-2f96-4d68-8efa-5e8cc7229aba tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6.5b232877-5959-4dce-a8dc-873a16eecbaa" returned: 0 in 0.683s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:48 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b34bd7a7-2f96-4d68-8efa-5e8cc7229aba tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "cinder-quobyte-5b232877-5959-4dce-a8dc-873a16eecbaa" released by "_delete_snapshot" :: held 3.346s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:21:48 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b34bd7a7-2f96-4d68-8efa-5e8cc7229aba tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "cinder-quobyte-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6" released by "delete_snapshot" :: held 3.377s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:21:48 devstack sudo[109489]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ce9f688c-0dd7-4b1b-8095-745fa740859c tempest-VolumeDependencyTests-1705073832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-665397b0-af62-40e8-af6c-b2c0a869bce7 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7.7aa981e1-9dd1-41ae-a39e-334a1cc06c41" returned: 0 in 0.737s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:48 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-ce9f688c-0dd7-4b1b-8095-745fa740859c tempest-VolumeDependencyTests-1705073832 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7.7aa981e1-9dd1-41ae-a39e-334a1cc06c41 is being set with open permissions: ugo+rw Jun 29 11:21:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ce9f688c-0dd7-4b1b-8095-745fa740859c tempest-VolumeDependencyTests-1705073832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7.7aa981e1-9dd1-41ae-a39e-334a1cc06c41 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:48 devstack sudo[109495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7.7aa981e1-9dd1-41ae-a39e-334a1cc06c41 Jun 29 11:21:48 devstack sudo[109495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:48 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-b34bd7a7-2f96-4d68-8efa-5e8cc7229aba tempest-VolumesSnapshotListTestJSON-529620200 None] Created reservations ['369b6b03-e24d-4ac9-890e-828be3782f06', '7d314fea-ad10-41a6-a9d2-bdfee5b7097e', '9d5f6db8-1e88-4c22-bccd-04c7551e0ef1', '45b2374b-c3d7-4157-9abe-c375226762f3'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:21:49 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-b34bd7a7-2f96-4d68-8efa-5e8cc7229aba tempest-VolumesSnapshotListTestJSON-529620200 None] Delete snapshot completed successfully. Jun 29 11:21:49 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b34bd7a7-2f96-4d68-8efa-5e8cc7229aba tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "cinder-5b232877-5959-4dce-a8dc-873a16eecbaa-delete_snapshot" released by "delete_snapshot" :: held 3.537s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:21:49 devstack sudo[109495]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ce9f688c-0dd7-4b1b-8095-745fa740859c tempest-VolumeDependencyTests-1705073832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7.7aa981e1-9dd1-41ae-a39e-334a1cc06c41" returned: 0 in 0.635s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ce9f688c-0dd7-4b1b-8095-745fa740859c tempest-VolumeDependencyTests-1705073832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:49 devstack sudo[109501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7.info Jun 29 11:21:49 devstack sudo[109501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:49 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-cf3a8a83-ea73-4ef8-8f83-8f0a7b5e667a tempest-VolumesSnapshotListTestJSON-529620200 None] Acquiring lock "cinder-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:21:49 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-cf3a8a83-ea73-4ef8-8f83-8f0a7b5e667a tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "cinder-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:21:49 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-cf3a8a83-ea73-4ef8-8f83-8f0a7b5e667a tempest-VolumesSnapshotListTestJSON-529620200 None] Acquiring lock "cinder-quobyte-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:21:49 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-cf3a8a83-ea73-4ef8-8f83-8f0a7b5e667a tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "cinder-quobyte-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6" acquired by "delete_volume" :: waited 0.020s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:21:49 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[de968fba-3cde-422b-a77b-99d2230a1c01]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:21:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf3a8a83-ea73-4ef8-8f83-8f0a7b5e667a tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:50 devstack sudo[109503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6 Jun 29 11:21:50 devstack sudo[109503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:50 devstack sudo[109501]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ce9f688c-0dd7-4b1b-8095-745fa740859c tempest-VolumeDependencyTests-1705073832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7.info" returned: 0 in 0.744s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:50 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-ce9f688c-0dd7-4b1b-8095-745fa740859c tempest-VolumeDependencyTests-1705073832 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7.info is being set with open permissions: ugo+rw Jun 29 11:21:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ce9f688c-0dd7-4b1b-8095-745fa740859c tempest-VolumeDependencyTests-1705073832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:50 devstack sudo[109506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7.info Jun 29 11:21:50 devstack sudo[109506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:50 devstack sudo[109503]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf3a8a83-ea73-4ef8-8f83-8f0a7b5e667a tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6" returned: 0 in 0.779s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf3a8a83-ea73-4ef8-8f83-8f0a7b5e667a tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:50 devstack sudo[109511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6 Jun 29 11:21:50 devstack sudo[109511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:51 devstack sudo[109506]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ce9f688c-0dd7-4b1b-8095-745fa740859c tempest-VolumeDependencyTests-1705073832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7.info" returned: 0 in 0.676s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ce9f688c-0dd7-4b1b-8095-745fa740859c tempest-VolumeDependencyTests-1705073832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.447s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:21:51 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-ce9f688c-0dd7-4b1b-8095-745fa740859c tempest-VolumeDependencyTests-1705073832 None] Create snapshot completed successfully Jun 29 11:21:51 devstack sudo[109511]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf3a8a83-ea73-4ef8-8f83-8f0a7b5e667a tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6" returned: 0 in 0.687s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:51 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-cf3a8a83-ea73-4ef8-8f83-8f0a7b5e667a tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "cinder-quobyte-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6" released by "delete_volume" :: held 1.539s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:21:51 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-cf3a8a83-ea73-4ef8-8f83-8f0a7b5e667a tempest-VolumesSnapshotListTestJSON-529620200 None] Created reservations ['ed4f64d5-3f7b-4cfb-b379-0b462f07c97b', '1f469d76-7607-4a61-9a3e-930b283afe0c', '24a55fcd-9d3c-4b4c-b4bf-a55650386c46', '14b8f5d8-dcdd-4a77-a19e-0e944ce0dcc0'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:21:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-cf3a8a83-ea73-4ef8-8f83-8f0a7b5e667a tempest-VolumesSnapshotListTestJSON-529620200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:21:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-cf3a8a83-ea73-4ef8-8f83-8f0a7b5e667a tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:21:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-cf3a8a83-ea73-4ef8-8f83-8f0a7b5e667a tempest-VolumesSnapshotListTestJSON-529620200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:21:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-cf3a8a83-ea73-4ef8-8f83-8f0a7b5e667a tempest-VolumesSnapshotListTestJSON-529620200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:21:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-cf3a8a83-ea73-4ef8-8f83-8f0a7b5e667a tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:21:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf3a8a83-ea73-4ef8-8f83-8f0a7b5e667a tempest-VolumesSnapshotListTestJSON-529620200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:51 devstack sudo[109548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:21:51 devstack sudo[109548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:52 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:21:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Flow 'volume_create_manager' (be8f3ea8-f7c6-427d-ba2e-66f40a9e0f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:21:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96569cb0-ffc4-472f-be5a-8422acecb1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96569cb0-ffc4-472f-be5a-8422acecb1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1741908449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07d7479c-1a17-4141-9073-ec0318be74e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3d55be2b8094b989fd52467eebb6263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7aa981e1-9dd1-41ae-a39e-334a1cc06c41,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:21:53Z,use_quota=True,user_id='f1038dba93984e0c8e166ea45c00ca28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e03019fb-594b-47d8-89ec-2ded99bf241b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e03019fb-594b-47d8-89ec-2ded99bf241b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d09ebb2-e09b-43ab-b6be-92f15c1fefc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d09ebb2-e09b-43ab-b6be-92f15c1fefc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '07d7479c-1a17-4141-9073-ec0318be74e8', 'volume_name': 'volume-07d7479c-1a17-4141-9073-ec0318be74e8', 'volume_size': 1, 'snapshot_id': '7aa981e1-9dd1-41ae-a39e-334a1cc06c41'}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb74906e-f16f-48c2-b6a7-3c40a2d8fb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb74906e-f16f-48c2-b6a7-3c40a2d8fb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:21:52 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (905b5092-4285-45de-a82e-ec11925ed936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:21:52 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Volume 07d7479c-1a17-4141-9073-ec0318be74e8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-07d7479c-1a17-4141-9073-ec0318be74e8', 'volume_size': 1, 'snapshot_id': '7aa981e1-9dd1-41ae-a39e-334a1cc06c41'} Jun 29 11:21:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:21:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:21:52 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Acquiring lock "cinder-quobyte-7aa981e1-9dd1-41ae-a39e-334a1cc06c41-07d7479c-1a17-4141-9073-ec0318be74e8" by "_create_volume_from_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:21:52 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Lock "cinder-quobyte-7aa981e1-9dd1-41ae-a39e-334a1cc06c41-07d7479c-1a17-4141-9073-ec0318be74e8" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:21:52 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Creating volume 07d7479c-1a17-4141-9073-ec0318be74e8 from snapshot 7aa981e1-9dd1-41ae-a39e-334a1cc06c41 {{(pid=93497) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 29 11:21:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:21:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:21:52 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:21:52 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:21:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:21:52 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:21:52 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Acquiring lock "cinder-quobyte-07d7479c-1a17-4141-9073-ec0318be74e8" by "_copy_volume_from_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:21:53 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Lock "cinder-quobyte-07d7479c-1a17-4141-9073-ec0318be74e8" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:21:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] snapshot: 7aa981e1-9dd1-41ae-a39e-334a1cc06c41, volume: 07d7479c-1a17-4141-9073-ec0318be74e8, {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 11:21:53 devstack sudo[109548]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:21:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:21:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:21:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:21:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:21:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf3a8a83-ea73-4ef8-8f83-8f0a7b5e667a tempest-VolumesSnapshotListTestJSON-529620200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.467s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:53 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-cf3a8a83-ea73-4ef8-8f83-8f0a7b5e667a tempest-VolumesSnapshotListTestJSON-529620200 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:21:53 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-cf3a8a83-ea73-4ef8-8f83-8f0a7b5e667a tempest-VolumesSnapshotListTestJSON-529620200 None] Deleted volume successfully. Jun 29 11:21:53 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[73299921-aa78-4a6b-9f65-ae28db2d7ecf]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:21:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7.7aa981e1-9dd1-41ae-a39e-334a1cc06c41 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:53 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-cf3a8a83-ea73-4ef8-8f83-8f0a7b5e667a tempest-VolumesSnapshotListTestJSON-529620200 None] Lock "cinder-cafa8d2d-2e11-4ecc-b0f1-8e4e7cec4ac6-delete_volume" released by "delete_volume" :: held 3.358s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:21:53 devstack sudo[109599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7.7aa981e1-9dd1-41ae-a39e-334a1cc06c41 Jun 29 11:21:53 devstack sudo[109599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:54 devstack sudo[109599]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7.7aa981e1-9dd1-41ae-a39e-334a1cc06c41" returned: 0 in 1.162s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-665397b0-af62-40e8-af6c-b2c0a869bce7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:21:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7 {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 11:21:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Creating direct copy from snapshot {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 11:21:54 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d12d196-38e8-4a85-b13e-1d13b4c125ae]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:21:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:54 devstack sudo[109641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7 Jun 29 11:21:54 devstack sudo[109641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:21:55 devstack sudo[109641]: pam_unix(sudo:session): session closed for user root Jun 29 11:21:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7" returned: 0 in 1.021s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:21:55 devstack cinder-volume[93497]: DEBUG cinder.utils [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Path /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-07d7479c-1a17-4141-9073-ec0318be74e8 not found in is_blk_device check {{(pid=93497) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 11:21:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-07d7479c-1a17-4141-9073-ec0318be74e8 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:21:55 devstack sudo[109646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-07d7479c-1a17-4141-9073-ec0318be74e8 Jun 29 11:21:55 devstack sudo[109646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:22:02 devstack sudo[109646]: pam_unix(sudo:session): session closed for user root Jun 29 11:22:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-07d7479c-1a17-4141-9073-ec0318be74e8" returned: 0 in 7.535s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:22:02 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bd5eca-6bf4-416c-b73e-a1462fff7973]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:22:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:22:03 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=22,cinder:INSERT=6,cinder:UPDATE=20,cinder:DELETE=1 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:22:03 devstack sudo[109662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7 Jun 29 11:22:03 devstack sudo[109662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:22:03 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=22,cinder:INSERT=8,cinder:UPDATE=27,cinder:DELETE=2 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:22:03 devstack sudo[109662]: pam_unix(sudo:session): session closed for user root Jun 29 11:22:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7" returned: 0 in 1.008s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:22:03 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Image conversion details: src /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7, size 1024.00 MB, duration 7.54 sec, destination /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-07d7479c-1a17-4141-9073-ec0318be74e8 {{(pid=93497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 11:22:03 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Converted 1024.00 MB image at 135.82 MB/s Jun 29 11:22:03 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-07d7479c-1a17-4141-9073-ec0318be74e8 is being set with open permissions: ugo+rw Jun 29 11:22:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-07d7479c-1a17-4141-9073-ec0318be74e8 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:22:04 devstack sudo[109667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-07d7479c-1a17-4141-9073-ec0318be74e8 Jun 29 11:22:04 devstack sudo[109667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:22:04 devstack sudo[109667]: pam_unix(sudo:session): session closed for user root Jun 29 11:22:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-07d7479c-1a17-4141-9073-ec0318be74e8" returned: 0 in 0.703s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:22:04 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Lock "cinder-quobyte-07d7479c-1a17-4141-9073-ec0318be74e8" released by "_copy_volume_from_snapshot" :: held 11.683s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:22:04 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Lock "cinder-quobyte-7aa981e1-9dd1-41ae-a39e-334a1cc06c41-07d7479c-1a17-4141-9073-ec0318be74e8" released by "_create_volume_from_snapshot" :: held 11.729s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:22:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.758s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:22:04 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (905b5092-4285-45de-a82e-ec11925ed936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07d7479c-1a17-4141-9073-ec0318be74e8', 'volume_size': 1, 'snapshot_id': '7aa981e1-9dd1-41ae-a39e-334a1cc06c41'}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:22:04 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b578ca7-a560-4ed4-a327-5144ee26d5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:22:04 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Volume volume-07d7479c-1a17-4141-9073-ec0318be74e8 (07d7479c-1a17-4141-9073-ec0318be74e8): created successfully Jun 29 11:22:04 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b578ca7-a560-4ed4-a327-5144ee26d5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:22:04 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Flow 'volume_create_manager' (be8f3ea8-f7c6-427d-ba2e-66f40a9e0f18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:22:04 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-4063408c-825c-4402-b583-56ee496d086d tempest-VolumeDependencyTests-1705073832 None] Created volume successfully. Jun 29 11:22:05 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b01e2357-6b94-453d-bb76-dff289cfc66d tempest-VolumeDependencyTests-1705073832 None] Acquiring lock "cinder-7aa981e1-9dd1-41ae-a39e-334a1cc06c41-delete_snapshot" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:22:05 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b01e2357-6b94-453d-bb76-dff289cfc66d tempest-VolumeDependencyTests-1705073832 None] Lock "cinder-7aa981e1-9dd1-41ae-a39e-334a1cc06c41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:22:05 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b01e2357-6b94-453d-bb76-dff289cfc66d tempest-VolumeDependencyTests-1705073832 None] Acquiring lock "cinder-quobyte-665397b0-af62-40e8-af6c-b2c0a869bce7" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:22:05 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b01e2357-6b94-453d-bb76-dff289cfc66d tempest-VolumeDependencyTests-1705073832 None] Lock "cinder-quobyte-665397b0-af62-40e8-af6c-b2c0a869bce7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:22:05 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b01e2357-6b94-453d-bb76-dff289cfc66d tempest-VolumeDependencyTests-1705073832 None] Acquiring lock "cinder-quobyte-7aa981e1-9dd1-41ae-a39e-334a1cc06c41" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:22:05 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b01e2357-6b94-453d-bb76-dff289cfc66d tempest-VolumeDependencyTests-1705073832 None] Lock "cinder-quobyte-7aa981e1-9dd1-41ae-a39e-334a1cc06c41" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:22:05 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-b01e2357-6b94-453d-bb76-dff289cfc66d tempest-VolumeDependencyTests-1705073832 None] Deleting offline snapshot 7aa981e1-9dd1-41ae-a39e-334a1cc06c41 of volume 665397b0-af62-40e8-af6c-b2c0a869bce7 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:22:05 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-b01e2357-6b94-453d-bb76-dff289cfc66d tempest-VolumeDependencyTests-1705073832 None] snapshot_file for this snap is: volume-665397b0-af62-40e8-af6c-b2c0a869bce7.7aa981e1-9dd1-41ae-a39e-334a1cc06c41 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:22:05 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7e7a82-a90c-4ab4-afc5-a602fea0ec53]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:22:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b01e2357-6b94-453d-bb76-dff289cfc66d tempest-VolumeDependencyTests-1705073832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7.7aa981e1-9dd1-41ae-a39e-334a1cc06c41 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:22:05 devstack sudo[109688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7.7aa981e1-9dd1-41ae-a39e-334a1cc06c41 Jun 29 11:22:05 devstack sudo[109688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:22:06 devstack sudo[109688]: pam_unix(sudo:session): session closed for user root Jun 29 11:22:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b01e2357-6b94-453d-bb76-dff289cfc66d tempest-VolumeDependencyTests-1705073832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7.7aa981e1-9dd1-41ae-a39e-334a1cc06c41" returned: 0 in 1.007s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:22:06 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-b01e2357-6b94-453d-bb76-dff289cfc66d tempest-VolumeDependencyTests-1705073832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-665397b0-af62-40e8-af6c-b2c0a869bce7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:22:06 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[45004cb7-3732-4d50-ba3f-03661344bdcf]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:22:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b01e2357-6b94-453d-bb76-dff289cfc66d tempest-VolumeDependencyTests-1705073832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:22:06 devstack sudo[109693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7 Jun 29 11:22:06 devstack sudo[109693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:22:07 devstack sudo[109693]: pam_unix(sudo:session): session closed for user root Jun 29 11:22:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b01e2357-6b94-453d-bb76-dff289cfc66d tempest-VolumeDependencyTests-1705073832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7" returned: 0 in 0.764s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:22:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b01e2357-6b94-453d-bb76-dff289cfc66d tempest-VolumeDependencyTests-1705073832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7.7aa981e1-9dd1-41ae-a39e-334a1cc06c41 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:22:07 devstack sudo[109698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7.7aa981e1-9dd1-41ae-a39e-334a1cc06c41 Jun 29 11:22:07 devstack sudo[109698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:22:07 devstack sudo[109698]: pam_unix(sudo:session): session closed for user root Jun 29 11:22:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b01e2357-6b94-453d-bb76-dff289cfc66d tempest-VolumeDependencyTests-1705073832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7.7aa981e1-9dd1-41ae-a39e-334a1cc06c41" returned: 0 in 0.773s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:22:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b01e2357-6b94-453d-bb76-dff289cfc66d tempest-VolumeDependencyTests-1705073832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7.7aa981e1-9dd1-41ae-a39e-334a1cc06c41 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:22:07 devstack sudo[109704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7.7aa981e1-9dd1-41ae-a39e-334a1cc06c41 Jun 29 11:22:07 devstack sudo[109704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:22:08 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager._thread_info {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:22:08 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread count: 29 {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 11:22:08 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread info: [<_MainThread(MainThread, started 131117520400512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 11:22:08 devstack sudo[109704]: pam_unix(sudo:session): session closed for user root Jun 29 11:22:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b01e2357-6b94-453d-bb76-dff289cfc66d tempest-VolumeDependencyTests-1705073832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7.7aa981e1-9dd1-41ae-a39e-334a1cc06c41" returned: 0 in 0.651s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:22:08 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b01e2357-6b94-453d-bb76-dff289cfc66d tempest-VolumeDependencyTests-1705073832 None] Lock "cinder-quobyte-7aa981e1-9dd1-41ae-a39e-334a1cc06c41" released by "_delete_snapshot" :: held 3.310s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:22:08 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b01e2357-6b94-453d-bb76-dff289cfc66d tempest-VolumeDependencyTests-1705073832 None] Lock "cinder-quobyte-665397b0-af62-40e8-af6c-b2c0a869bce7" released by "delete_snapshot" :: held 3.352s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:22:08 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-b01e2357-6b94-453d-bb76-dff289cfc66d tempest-VolumeDependencyTests-1705073832 None] Created reservations ['64603875-48e1-4fde-b92e-3fd9e4c7c769', '69601a8a-7d60-41b1-932c-215699838c2f', '2766212f-4acf-498f-aa76-9fa612eaa3d3', 'fa63b218-dc75-434d-a2cd-d8cc70bc802a'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:22:08 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-b01e2357-6b94-453d-bb76-dff289cfc66d tempest-VolumeDependencyTests-1705073832 None] Delete snapshot completed successfully. Jun 29 11:22:08 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b01e2357-6b94-453d-bb76-dff289cfc66d tempest-VolumeDependencyTests-1705073832 None] Lock "cinder-7aa981e1-9dd1-41ae-a39e-334a1cc06c41-delete_snapshot" released by "delete_snapshot" :: held 3.515s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:22:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e7f4f167-129c-4051-8425-d8262da342ef tempest-VolumeDependencyTests-1705073832 None] Acquiring lock "cinder-665397b0-af62-40e8-af6c-b2c0a869bce7-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:22:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e7f4f167-129c-4051-8425-d8262da342ef tempest-VolumeDependencyTests-1705073832 None] Lock "cinder-665397b0-af62-40e8-af6c-b2c0a869bce7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:22:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e7f4f167-129c-4051-8425-d8262da342ef tempest-VolumeDependencyTests-1705073832 None] Acquiring lock "cinder-quobyte-665397b0-af62-40e8-af6c-b2c0a869bce7" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:22:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e7f4f167-129c-4051-8425-d8262da342ef tempest-VolumeDependencyTests-1705073832 None] Lock "cinder-quobyte-665397b0-af62-40e8-af6c-b2c0a869bce7" acquired by "delete_volume" :: waited 0.016s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:22:09 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5899712-5191-4efe-9727-3e2dc6892a0f]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:22:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e7f4f167-129c-4051-8425-d8262da342ef tempest-VolumeDependencyTests-1705073832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:22:09 devstack sudo[109708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7 Jun 29 11:22:09 devstack sudo[109708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:22:10 devstack sudo[109708]: pam_unix(sudo:session): session closed for user root Jun 29 11:22:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e7f4f167-129c-4051-8425-d8262da342ef tempest-VolumeDependencyTests-1705073832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7" returned: 0 in 0.786s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:22:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e7f4f167-129c-4051-8425-d8262da342ef tempest-VolumeDependencyTests-1705073832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:22:10 devstack sudo[109717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7 Jun 29 11:22:10 devstack sudo[109717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:22:11 devstack sudo[109717]: pam_unix(sudo:session): session closed for user root Jun 29 11:22:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e7f4f167-129c-4051-8425-d8262da342ef tempest-VolumeDependencyTests-1705073832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-665397b0-af62-40e8-af6c-b2c0a869bce7" returned: 0 in 0.746s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:22:11 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e7f4f167-129c-4051-8425-d8262da342ef tempest-VolumeDependencyTests-1705073832 None] Lock "cinder-quobyte-665397b0-af62-40e8-af6c-b2c0a869bce7" released by "delete_volume" :: held 1.601s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:22:11 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-e7f4f167-129c-4051-8425-d8262da342ef tempest-VolumeDependencyTests-1705073832 None] Created reservations ['fc1245a4-9567-4792-af7d-e6d05b81715c', '0f2d801a-6ba6-4711-9e40-777a3685bf59', '02babbbb-8f10-479d-9e1f-9951e3ea03dd', '670371f7-f284-4a74-a095-1f6efbcfe60d'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:22:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e7f4f167-129c-4051-8425-d8262da342ef tempest-VolumeDependencyTests-1705073832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:22:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e7f4f167-129c-4051-8425-d8262da342ef tempest-VolumeDependencyTests-1705073832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:22:11 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-e7f4f167-129c-4051-8425-d8262da342ef tempest-VolumeDependencyTests-1705073832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:22:11 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-e7f4f167-129c-4051-8425-d8262da342ef tempest-VolumeDependencyTests-1705073832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:22:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e7f4f167-129c-4051-8425-d8262da342ef tempest-VolumeDependencyTests-1705073832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:22:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e7f4f167-129c-4051-8425-d8262da342ef tempest-VolumeDependencyTests-1705073832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:22:11 devstack sudo[109722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:22:11 devstack sudo[109722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:22:11 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0281d1de-5d11-44d3-ab8e-02a5ff6771ad tempest-VolumeDependencyTests-1705073832 None] Acquiring lock "cinder-07d7479c-1a17-4141-9073-ec0318be74e8-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:22:11 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0281d1de-5d11-44d3-ab8e-02a5ff6771ad tempest-VolumeDependencyTests-1705073832 None] Lock "cinder-07d7479c-1a17-4141-9073-ec0318be74e8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:22:11 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0281d1de-5d11-44d3-ab8e-02a5ff6771ad tempest-VolumeDependencyTests-1705073832 None] Acquiring lock "cinder-quobyte-07d7479c-1a17-4141-9073-ec0318be74e8" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:22:11 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0281d1de-5d11-44d3-ab8e-02a5ff6771ad tempest-VolumeDependencyTests-1705073832 None] Lock "cinder-quobyte-07d7479c-1a17-4141-9073-ec0318be74e8" acquired by "delete_volume" :: waited 0.018s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:22:11 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[457dedeb-a867-4a6d-9951-1ca312b55f38]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:22:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0281d1de-5d11-44d3-ab8e-02a5ff6771ad tempest-VolumeDependencyTests-1705073832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-07d7479c-1a17-4141-9073-ec0318be74e8 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:22:11 devstack sudo[109725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-07d7479c-1a17-4141-9073-ec0318be74e8 Jun 29 11:22:11 devstack sudo[109725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:22:12 devstack sudo[109722]: pam_unix(sudo:session): session closed for user root Jun 29 11:22:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e7f4f167-129c-4051-8425-d8262da342ef tempest-VolumeDependencyTests-1705073832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.864s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:22:12 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-e7f4f167-129c-4051-8425-d8262da342ef tempest-VolumeDependencyTests-1705073832 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:22:12 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-e7f4f167-129c-4051-8425-d8262da342ef tempest-VolumeDependencyTests-1705073832 None] Deleted volume successfully. Jun 29 11:22:12 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e7f4f167-129c-4051-8425-d8262da342ef tempest-VolumeDependencyTests-1705073832 None] Lock "cinder-665397b0-af62-40e8-af6c-b2c0a869bce7-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:22:12 devstack sudo[109725]: pam_unix(sudo:session): session closed for user root Jun 29 11:22:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0281d1de-5d11-44d3-ab8e-02a5ff6771ad tempest-VolumeDependencyTests-1705073832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-07d7479c-1a17-4141-9073-ec0318be74e8" returned: 0 in 0.860s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:22:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0281d1de-5d11-44d3-ab8e-02a5ff6771ad tempest-VolumeDependencyTests-1705073832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-07d7479c-1a17-4141-9073-ec0318be74e8 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:22:12 devstack sudo[109731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-07d7479c-1a17-4141-9073-ec0318be74e8 Jun 29 11:22:12 devstack sudo[109731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:22:13 devstack sudo[109731]: pam_unix(sudo:session): session closed for user root Jun 29 11:22:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0281d1de-5d11-44d3-ab8e-02a5ff6771ad tempest-VolumeDependencyTests-1705073832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-07d7479c-1a17-4141-9073-ec0318be74e8" returned: 0 in 0.867s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:22:13 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0281d1de-5d11-44d3-ab8e-02a5ff6771ad tempest-VolumeDependencyTests-1705073832 None] Lock "cinder-quobyte-07d7479c-1a17-4141-9073-ec0318be74e8" released by "delete_volume" :: held 1.778s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:22:13 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-0281d1de-5d11-44d3-ab8e-02a5ff6771ad tempest-VolumeDependencyTests-1705073832 None] Created reservations ['a149cb96-af73-4e34-be2a-8e58fa947222', '05a6dcc6-0570-46db-931e-35e85eaab94b', 'f51a3cd6-4e94-4fdd-93fe-b36990ad499b', 'e7253c15-8c2d-451e-8e39-dad48c9a7171'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:22:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0281d1de-5d11-44d3-ab8e-02a5ff6771ad tempest-VolumeDependencyTests-1705073832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:22:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0281d1de-5d11-44d3-ab8e-02a5ff6771ad tempest-VolumeDependencyTests-1705073832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:22:13 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0281d1de-5d11-44d3-ab8e-02a5ff6771ad tempest-VolumeDependencyTests-1705073832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:22:13 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0281d1de-5d11-44d3-ab8e-02a5ff6771ad tempest-VolumeDependencyTests-1705073832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:22:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0281d1de-5d11-44d3-ab8e-02a5ff6771ad tempest-VolumeDependencyTests-1705073832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:22:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0281d1de-5d11-44d3-ab8e-02a5ff6771ad tempest-VolumeDependencyTests-1705073832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:22:13 devstack sudo[109734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:22:13 devstack sudo[109734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:22:14 devstack sudo[109734]: pam_unix(sudo:session): session closed for user root Jun 29 11:22:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0281d1de-5d11-44d3-ab8e-02a5ff6771ad tempest-VolumeDependencyTests-1705073832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.775s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:22:14 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-0281d1de-5d11-44d3-ab8e-02a5ff6771ad tempest-VolumeDependencyTests-1705073832 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:22:14 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-0281d1de-5d11-44d3-ab8e-02a5ff6771ad tempest-VolumeDependencyTests-1705073832 None] Deleted volume successfully. Jun 29 11:22:14 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0281d1de-5d11-44d3-ab8e-02a5ff6771ad tempest-VolumeDependencyTests-1705073832 None] Lock "cinder-07d7479c-1a17-4141-9073-ec0318be74e8-delete_volume" released by "delete_volume" :: held 2.838s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:22:23 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=19,cinder:UPDATE=17,cinder:DELETE=1,cinder:INSERT=10 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:22:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-e7e538f7-76b5-456e-b1e0-910ae010ec2a req-cd6d30bf-dc34-42be-bb8b-a27815205170 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:22:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-e7e538f7-76b5-456e-b1e0-910ae010ec2a req-cd6d30bf-dc34-42be-bb8b-a27815205170 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:22:24 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f480bc9e-c80c-4e17-879b-7468fff0b3af]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:22:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-e7e538f7-76b5-456e-b1e0-910ae010ec2a req-cd6d30bf-dc34-42be-bb8b-a27815205170 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0913dc7f-b014-4992-a11c-46b8eab6c8a7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:22:24 devstack sudo[109754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0913dc7f-b014-4992-a11c-46b8eab6c8a7 Jun 29 11:22:24 devstack sudo[109754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:22:24 devstack sudo[109754]: pam_unix(sudo:session): session closed for user root Jun 29 11:22:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-e7e538f7-76b5-456e-b1e0-910ae010ec2a req-cd6d30bf-dc34-42be-bb8b-a27815205170 tempest-TestServerVolumeAttachmentScenario-1545034146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0913dc7f-b014-4992-a11c-46b8eab6c8a7" returned: 0 in 0.777s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:22:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-e7e538f7-76b5-456e-b1e0-910ae010ec2a req-cd6d30bf-dc34-42be-bb8b-a27815205170 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.804s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:22:25 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-e7e538f7-76b5-456e-b1e0-910ae010ec2a req-cd6d30bf-dc34-42be-bb8b-a27815205170 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3', 'name': 'volume-0913dc7f-b014-4992-a11c-46b8eab6c8a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a0cec779-a42a-4ef2-ac48-cdb584a50995', 'enforce_multipath': True} {{(pid=93497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 11:22:25 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-e7e538f7-76b5-456e-b1e0-910ae010ec2a req-cd6d30bf-dc34-42be-bb8b-a27815205170 tempest-TestServerVolumeAttachmentScenario-1545034146 None] attachment_update completed successfully. Jun 29 11:22:35 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:UPDATE=31,cinder:SELECT=17,cinder:INSERT=2,cinder:DELETE=2 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:22:35 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:22:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-0f7d0af0-5f20-4d59-910b-779f83c4a693 req-d876496a-598b-427f-9f0b-2ee6530a4c99 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:22:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-0f7d0af0-5f20-4d59-910b-779f83c4a693 req-d876496a-598b-427f-9f0b-2ee6530a4c99 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:22:35 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[529f890b-de76-4e7e-b394-65e6c828d515]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:22:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-0f7d0af0-5f20-4d59-910b-779f83c4a693 req-d876496a-598b-427f-9f0b-2ee6530a4c99 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-51fa0053-0bb7-4b8d-b5d9-15987acd5845 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:22:35 devstack sudo[110175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-51fa0053-0bb7-4b8d-b5d9-15987acd5845 Jun 29 11:22:35 devstack sudo[110175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:22:36 devstack sudo[110175]: pam_unix(sudo:session): session closed for user root Jun 29 11:22:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-0f7d0af0-5f20-4d59-910b-779f83c4a693 req-d876496a-598b-427f-9f0b-2ee6530a4c99 tempest-TestServerVolumeAttachmentScenario-1545034146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-51fa0053-0bb7-4b8d-b5d9-15987acd5845" returned: 0 in 0.749s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:22:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-0f7d0af0-5f20-4d59-910b-779f83c4a693 req-d876496a-598b-427f-9f0b-2ee6530a4c99 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.775s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:22:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-0f7d0af0-5f20-4d59-910b-779f83c4a693 req-d876496a-598b-427f-9f0b-2ee6530a4c99 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3', 'name': 'volume-51fa0053-0bb7-4b8d-b5d9-15987acd5845', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cf980cdb-4ed3-49af-a7ac-dd83311d4116', 'enforce_multipath': True} {{(pid=93497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 11:22:36 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-0f7d0af0-5f20-4d59-910b-779f83c4a693 req-d876496a-598b-427f-9f0b-2ee6530a4c99 tempest-TestServerVolumeAttachmentScenario-1545034146 None] attachment_update completed successfully. Jun 29 11:22:42 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-97eeefee-3399-4c8c-8a83-23fcfbd7aed4 req-2acdc2f8-622f-4532-bec8-4897f38013c2 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Terminate volume connection completed successfully. Jun 29 11:22:42 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-97eeefee-3399-4c8c-8a83-23fcfbd7aed4 req-2acdc2f8-622f-4532-bec8-4897f38013c2 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Deleting attachment cf980cdb-4ed3-49af-a7ac-dd83311d4116. {{(pid=93497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 11:22:45 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-769bccd8-7c1c-4c18-bee1-2fd05318ab90 req-96451f04-820d-4bb1-9b8b-0684c3edd89e tempest-TestServerVolumeAttachmentScenario-1545034146 None] Terminate volume connection completed successfully. Jun 29 11:22:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-769bccd8-7c1c-4c18-bee1-2fd05318ab90 req-96451f04-820d-4bb1-9b8b-0684c3edd89e tempest-TestServerVolumeAttachmentScenario-1545034146 None] Deleting attachment a0cec779-a42a-4ef2-ac48-cdb584a50995. {{(pid=93497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 11:22:52 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:22:55 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:22:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-182bb785-2207-4979-a862-bec83449213c tempest-TestServerVolumeAttachmentScenario-1545034146 None] Acquiring lock "cinder-51fa0053-0bb7-4b8d-b5d9-15987acd5845-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:22:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-182bb785-2207-4979-a862-bec83449213c tempest-TestServerVolumeAttachmentScenario-1545034146 None] Lock "cinder-51fa0053-0bb7-4b8d-b5d9-15987acd5845-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:22:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-182bb785-2207-4979-a862-bec83449213c tempest-TestServerVolumeAttachmentScenario-1545034146 None] Acquiring lock "cinder-quobyte-51fa0053-0bb7-4b8d-b5d9-15987acd5845" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:22:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-182bb785-2207-4979-a862-bec83449213c tempest-TestServerVolumeAttachmentScenario-1545034146 None] Lock "cinder-quobyte-51fa0053-0bb7-4b8d-b5d9-15987acd5845" acquired by "delete_volume" :: waited 0.015s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:22:55 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f49d01-a1c7-46a5-8c31-2a5e9f5ae214]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:22:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-182bb785-2207-4979-a862-bec83449213c tempest-TestServerVolumeAttachmentScenario-1545034146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-51fa0053-0bb7-4b8d-b5d9-15987acd5845 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:22:56 devstack sudo[110406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-51fa0053-0bb7-4b8d-b5d9-15987acd5845 Jun 29 11:22:56 devstack sudo[110406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:22:56 devstack sudo[110406]: pam_unix(sudo:session): session closed for user root Jun 29 11:22:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-182bb785-2207-4979-a862-bec83449213c tempest-TestServerVolumeAttachmentScenario-1545034146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-51fa0053-0bb7-4b8d-b5d9-15987acd5845" returned: 0 in 0.749s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:22:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-182bb785-2207-4979-a862-bec83449213c tempest-TestServerVolumeAttachmentScenario-1545034146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-51fa0053-0bb7-4b8d-b5d9-15987acd5845 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:22:56 devstack sudo[110411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-51fa0053-0bb7-4b8d-b5d9-15987acd5845 Jun 29 11:22:56 devstack sudo[110411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:22:57 devstack sudo[110411]: pam_unix(sudo:session): session closed for user root Jun 29 11:22:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-182bb785-2207-4979-a862-bec83449213c tempest-TestServerVolumeAttachmentScenario-1545034146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-51fa0053-0bb7-4b8d-b5d9-15987acd5845" returned: 0 in 0.681s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:22:57 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-182bb785-2207-4979-a862-bec83449213c tempest-TestServerVolumeAttachmentScenario-1545034146 None] Lock "cinder-quobyte-51fa0053-0bb7-4b8d-b5d9-15987acd5845" released by "delete_volume" :: held 1.476s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:22:57 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-182bb785-2207-4979-a862-bec83449213c tempest-TestServerVolumeAttachmentScenario-1545034146 None] Created reservations ['e6c225f5-234d-477f-8e81-e6c3e5c8da93', 'e7ae97a5-d152-427a-881a-1ab2147605eb', '61893a66-9f9a-4c0c-8c99-e3825057bee8', 'bafe8426-22ae-4ca6-b240-c69feab0c4fa'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:22:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-182bb785-2207-4979-a862-bec83449213c tempest-TestServerVolumeAttachmentScenario-1545034146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:22:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-182bb785-2207-4979-a862-bec83449213c tempest-TestServerVolumeAttachmentScenario-1545034146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:22:57 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-182bb785-2207-4979-a862-bec83449213c tempest-TestServerVolumeAttachmentScenario-1545034146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:22:57 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-182bb785-2207-4979-a862-bec83449213c tempest-TestServerVolumeAttachmentScenario-1545034146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:22:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-182bb785-2207-4979-a862-bec83449213c tempest-TestServerVolumeAttachmentScenario-1545034146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:22:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-182bb785-2207-4979-a862-bec83449213c tempest-TestServerVolumeAttachmentScenario-1545034146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:22:57 devstack sudo[110414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:22:57 devstack sudo[110414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:22:58 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-82f75494-8c5d-4c16-98da-c6b50f987808 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Acquiring lock "cinder-0913dc7f-b014-4992-a11c-46b8eab6c8a7-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:22:58 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-82f75494-8c5d-4c16-98da-c6b50f987808 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Lock "cinder-0913dc7f-b014-4992-a11c-46b8eab6c8a7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:22:58 devstack sudo[110414]: pam_unix(sudo:session): session closed for user root Jun 29 11:22:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-182bb785-2207-4979-a862-bec83449213c tempest-TestServerVolumeAttachmentScenario-1545034146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.652s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:22:58 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-182bb785-2207-4979-a862-bec83449213c tempest-TestServerVolumeAttachmentScenario-1545034146 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:22:58 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-182bb785-2207-4979-a862-bec83449213c tempest-TestServerVolumeAttachmentScenario-1545034146 None] Deleted volume successfully. Jun 29 11:22:58 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-82f75494-8c5d-4c16-98da-c6b50f987808 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Acquiring lock "cinder-quobyte-0913dc7f-b014-4992-a11c-46b8eab6c8a7" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:22:58 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-182bb785-2207-4979-a862-bec83449213c tempest-TestServerVolumeAttachmentScenario-1545034146 None] Lock "cinder-51fa0053-0bb7-4b8d-b5d9-15987acd5845-delete_volume" released by "delete_volume" :: held 2.337s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:22:58 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-82f75494-8c5d-4c16-98da-c6b50f987808 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Lock "cinder-quobyte-0913dc7f-b014-4992-a11c-46b8eab6c8a7" acquired by "delete_volume" :: waited 0.020s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:22:58 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cacf64-e0a7-47e7-9862-f9df90ce5084]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:22:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-82f75494-8c5d-4c16-98da-c6b50f987808 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0913dc7f-b014-4992-a11c-46b8eab6c8a7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:22:58 devstack sudo[110418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0913dc7f-b014-4992-a11c-46b8eab6c8a7 Jun 29 11:22:58 devstack sudo[110418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:22:58 devstack sudo[110418]: pam_unix(sudo:session): session closed for user root Jun 29 11:22:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-82f75494-8c5d-4c16-98da-c6b50f987808 tempest-TestServerVolumeAttachmentScenario-1545034146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0913dc7f-b014-4992-a11c-46b8eab6c8a7" returned: 0 in 0.767s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:22:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-82f75494-8c5d-4c16-98da-c6b50f987808 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0913dc7f-b014-4992-a11c-46b8eab6c8a7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:22:58 devstack sudo[110423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0913dc7f-b014-4992-a11c-46b8eab6c8a7 Jun 29 11:22:58 devstack sudo[110423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:22:59 devstack sudo[110423]: pam_unix(sudo:session): session closed for user root Jun 29 11:22:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-82f75494-8c5d-4c16-98da-c6b50f987808 tempest-TestServerVolumeAttachmentScenario-1545034146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0913dc7f-b014-4992-a11c-46b8eab6c8a7" returned: 0 in 0.640s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:22:59 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-82f75494-8c5d-4c16-98da-c6b50f987808 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Lock "cinder-quobyte-0913dc7f-b014-4992-a11c-46b8eab6c8a7" released by "delete_volume" :: held 1.454s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:22:59 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-82f75494-8c5d-4c16-98da-c6b50f987808 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Created reservations ['a9dd6f3b-230e-4e08-8473-6b1f08e55dbb', '90f7f84b-2cee-4835-903f-95dd56ba92bf', 'a25ba7cc-291c-460e-80ca-7409dcc1635d', '72b34c41-6c62-4b6b-b247-365a7f7fbe33'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:22:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-82f75494-8c5d-4c16-98da-c6b50f987808 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:22:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-82f75494-8c5d-4c16-98da-c6b50f987808 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:22:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-82f75494-8c5d-4c16-98da-c6b50f987808 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:22:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-82f75494-8c5d-4c16-98da-c6b50f987808 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:22:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-82f75494-8c5d-4c16-98da-c6b50f987808 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:22:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-82f75494-8c5d-4c16-98da-c6b50f987808 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:22:59 devstack sudo[110426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:22:59 devstack sudo[110426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:00 devstack sudo[110426]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-82f75494-8c5d-4c16-98da-c6b50f987808 tempest-TestServerVolumeAttachmentScenario-1545034146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.645s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:00 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-82f75494-8c5d-4c16-98da-c6b50f987808 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:23:00 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-82f75494-8c5d-4c16-98da-c6b50f987808 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Deleted volume successfully. Jun 29 11:23:00 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-82f75494-8c5d-4c16-98da-c6b50f987808 tempest-TestServerVolumeAttachmentScenario-1545034146 None] Lock "cinder-0913dc7f-b014-4992-a11c-46b8eab6c8a7-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:23:03 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:23:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Flow 'volume_create_manager' (feb7ec47-c899-431e-a7db-2292f1b72f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:23:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3c85e4-ed22-4b94-ba11-472d2f9e59bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3c85e4-ed22-4b94-ba11-472d2f9e59bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1008385848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33f5134c-43bc-4536-adc8-50aa2076c166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d854c60f842f4182942c68063ce647e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:23:03Z,use_quota=True,user_id='d29d6c4525e04dc8a6ed9b9d72cf9028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed04610d-21db-49b4-9931-4fdb07b9126c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed04610d-21db-49b4-9931-4fdb07b9126c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87ef9813-b74a-4459-9616-ab1d37e3dd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87ef9813-b74a-4459-9616-ab1d37e3dd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33f5134c-43bc-4536-adc8-50aa2076c166', 'volume_name': 'volume-33f5134c-43bc-4536-adc8-50aa2076c166', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (befd0195-fe81-4120-9756-a88495cccb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (befd0195-fe81-4120-9756-a88495cccb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (327c4946-c829-4cb5-b9d7-7a9b4fdf6469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:03 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Volume 33f5134c-43bc-4536-adc8-50aa2076c166: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33f5134c-43bc-4536-adc8-50aa2076c166', 'volume_size': 1} Jun 29 11:23:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:23:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:23:03 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1008385848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33f5134c-43bc-4536-adc8-50aa2076c166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d854c60f842f4182942c68063ce647e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:23:03Z,use_quota=True,user_id='d29d6c4525e04dc8a6ed9b9d72cf9028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:23:03 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Creating volume 33f5134c-43bc-4536-adc8-50aa2076c166 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:23:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:23:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:23:03 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:23:03 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:23:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:23:03 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:23:03 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:23:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33f5134c-43bc-4536-adc8-50aa2076c166 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:03 devstack sudo[110433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33f5134c-43bc-4536-adc8-50aa2076c166 1073741824 Jun 29 11:23:03 devstack sudo[110433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:04 devstack sudo[110433]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33f5134c-43bc-4536-adc8-50aa2076c166 1073741824" returned: 0 in 0.969s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33f5134c-43bc-4536-adc8-50aa2076c166 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:04 devstack sudo[110440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33f5134c-43bc-4536-adc8-50aa2076c166 Jun 29 11:23:04 devstack sudo[110440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:04 devstack sudo[110440]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33f5134c-43bc-4536-adc8-50aa2076c166" returned: 0 in 0.666s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:04 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:23:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:23:04 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (327c4946-c829-4cb5-b9d7-7a9b4fdf6469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33f5134c-43bc-4536-adc8-50aa2076c166', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:04 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f834c68-369f-48da-832d-1936d7ce0287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:04 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Volume volume-33f5134c-43bc-4536-adc8-50aa2076c166 (33f5134c-43bc-4536-adc8-50aa2076c166): created successfully Jun 29 11:23:04 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f834c68-369f-48da-832d-1936d7ce0287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:04 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Flow 'volume_create_manager' (feb7ec47-c899-431e-a7db-2292f1b72f4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:23:04 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-d4f3f5de-0b79-4b05-8871-4c2244786234 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Created volume successfully. Jun 29 11:23:08 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:23:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:23:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:23:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:23:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:23:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:23:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:08 devstack sudo[110453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:23:08 devstack sudo[110453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-5491fa79-07cd-4752-bdee-b826ba563221 req-a1f46cdf-e83e-4bac-8c54-767854a35c85 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:23:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-5491fa79-07cd-4752-bdee-b826ba563221 req-a1f46cdf-e83e-4bac-8c54-767854a35c85 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:23:08 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[824e261d-3dd8-49d5-98a6-324ecf255d1c]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:23:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-5491fa79-07cd-4752-bdee-b826ba563221 req-a1f46cdf-e83e-4bac-8c54-767854a35c85 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33f5134c-43bc-4536-adc8-50aa2076c166 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:08 devstack sudo[110457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33f5134c-43bc-4536-adc8-50aa2076c166 Jun 29 11:23:08 devstack sudo[110457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:08 devstack sudo[110453]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.740s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:08 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:23:08 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager._thread_info {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:23:08 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread count: 29 {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 11:23:08 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread info: [<_MainThread(MainThread, started 131117520400512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 11:23:09 devstack sudo[110457]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-5491fa79-07cd-4752-bdee-b826ba563221 req-a1f46cdf-e83e-4bac-8c54-767854a35c85 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33f5134c-43bc-4536-adc8-50aa2076c166" returned: 0 in 0.796s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-5491fa79-07cd-4752-bdee-b826ba563221 req-a1f46cdf-e83e-4bac-8c54-767854a35c85 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.818s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:23:09 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-5491fa79-07cd-4752-bdee-b826ba563221 req-a1f46cdf-e83e-4bac-8c54-767854a35c85 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3', 'name': 'volume-33f5134c-43bc-4536-adc8-50aa2076c166', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '762ba685-29ef-4675-991e-d3f58f54a3ca', 'enforce_multipath': True} {{(pid=93497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 11:23:09 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-5491fa79-07cd-4752-bdee-b826ba563221 req-a1f46cdf-e83e-4bac-8c54-767854a35c85 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] attachment_update completed successfully. Jun 29 11:23:16 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-d6807a76-103b-47ff-ae8a-0f2e24380933 req-a43c8675-beac-41c0-a55d-e072ff62ad22 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Terminate volume connection completed successfully. Jun 29 11:23:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-d6807a76-103b-47ff-ae8a-0f2e24380933 req-a43c8675-beac-41c0-a55d-e072ff62ad22 tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Deleting attachment 762ba685-29ef-4675-991e-d3f58f54a3ca. {{(pid=93497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 11:23:18 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-452180fe-245d-4442-8539-6046c01121bc tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Acquiring lock "cinder-33f5134c-43bc-4536-adc8-50aa2076c166-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:23:18 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-452180fe-245d-4442-8539-6046c01121bc tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Lock "cinder-33f5134c-43bc-4536-adc8-50aa2076c166-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:23:18 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-452180fe-245d-4442-8539-6046c01121bc tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Acquiring lock "cinder-quobyte-33f5134c-43bc-4536-adc8-50aa2076c166" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:23:18 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-452180fe-245d-4442-8539-6046c01121bc tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Lock "cinder-quobyte-33f5134c-43bc-4536-adc8-50aa2076c166" acquired by "delete_volume" :: waited 0.018s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:23:18 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7e4d76-9f4b-4580-9f2b-fc9d64507783]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:23:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-452180fe-245d-4442-8539-6046c01121bc tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33f5134c-43bc-4536-adc8-50aa2076c166 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:18 devstack sudo[110894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33f5134c-43bc-4536-adc8-50aa2076c166 Jun 29 11:23:18 devstack sudo[110894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:19 devstack sudo[110894]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-452180fe-245d-4442-8539-6046c01121bc tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33f5134c-43bc-4536-adc8-50aa2076c166" returned: 0 in 0.753s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-452180fe-245d-4442-8539-6046c01121bc tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33f5134c-43bc-4536-adc8-50aa2076c166 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:19 devstack sudo[110899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33f5134c-43bc-4536-adc8-50aa2076c166 Jun 29 11:23:19 devstack sudo[110899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:20 devstack sudo[110899]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-452180fe-245d-4442-8539-6046c01121bc tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-33f5134c-43bc-4536-adc8-50aa2076c166" returned: 0 in 0.739s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:20 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-452180fe-245d-4442-8539-6046c01121bc tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Lock "cinder-quobyte-33f5134c-43bc-4536-adc8-50aa2076c166" released by "delete_volume" :: held 1.535s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:23:20 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-452180fe-245d-4442-8539-6046c01121bc tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Created reservations ['c413c52e-d327-4766-b812-6714b6d2569e', 'c5ccaf0b-b939-46f2-9f4b-bfd64b092a1f', 'd21b03dc-5004-4292-b9a9-734470d351ba', 'b9076362-cc65-4919-93b1-41baed30efed'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:23:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-452180fe-245d-4442-8539-6046c01121bc tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:23:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-452180fe-245d-4442-8539-6046c01121bc tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:23:20 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-452180fe-245d-4442-8539-6046c01121bc tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:23:20 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-452180fe-245d-4442-8539-6046c01121bc tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:23:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-452180fe-245d-4442-8539-6046c01121bc tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:23:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-452180fe-245d-4442-8539-6046c01121bc tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:20 devstack sudo[110902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:23:20 devstack sudo[110902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:20 devstack sudo[110902]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-452180fe-245d-4442-8539-6046c01121bc tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.700s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:20 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-452180fe-245d-4442-8539-6046c01121bc tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:23:20 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-452180fe-245d-4442-8539-6046c01121bc tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Deleted volume successfully. Jun 29 11:23:20 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-452180fe-245d-4442-8539-6046c01121bc tempest-TestServerVolumeAttachScenarioOldVersion-1653095541 None] Lock "cinder-33f5134c-43bc-4536-adc8-50aa2076c166-delete_volume" released by "delete_volume" :: held 2.468s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:23:30 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=28,cinder:INSERT=4,cinder:UPDATE=26,cinder:DELETE=3 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:23:30 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:UPDATE=32,cinder:SELECT=20,cinder:INSERT=9,cinder:DELETE=1 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:23:36 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:23:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] Flow 'volume_create_manager' (dd21af8d-7c0d-449b-b201-b66697784620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:23:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08ee588b-4910-4410-aab8-49cc12ae2398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08ee588b-4910-4410-aab8-49cc12ae2398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1200895195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5028f72-8569-4b03-aa99-e8087f7f0daf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb8382e0833433b99304a20f1d7e080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:23:36Z,use_quota=True,user_id='6184260b075e446d9ea799fbd9911e5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b3cc7b6-4ee3-4bab-8482-52e54beec5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b3cc7b6-4ee3-4bab-8482-52e54beec5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6c375a2-52be-4183-9265-bb0c60ac5b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6c375a2-52be-4183-9265-bb0c60ac5b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5028f72-8569-4b03-aa99-e8087f7f0daf', 'volume_name': 'volume-f5028f72-8569-4b03-aa99-e8087f7f0daf', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dbc7b2e-7c38-40b2-a51a-0d4c90e02912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dbc7b2e-7c38-40b2-a51a-0d4c90e02912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:36 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c499328d-71cf-46d4-85e0-6e5a0a92853e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:36 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] Volume f5028f72-8569-4b03-aa99-e8087f7f0daf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5028f72-8569-4b03-aa99-e8087f7f0daf', 'volume_size': 1} Jun 29 11:23:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:23:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:23:36 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1200895195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5028f72-8569-4b03-aa99-e8087f7f0daf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb8382e0833433b99304a20f1d7e080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:23:36Z,use_quota=True,user_id='6184260b075e446d9ea799fbd9911e5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:23:36 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] Creating volume f5028f72-8569-4b03-aa99-e8087f7f0daf {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:23:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:23:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:23:36 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:23:36 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:23:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:23:36 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:23:36 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:23:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:36 devstack sudo[110951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf 1073741824 Jun 29 11:23:36 devstack sudo[110951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:37 devstack sudo[110951]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf 1073741824" returned: 0 in 1.008s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:37 devstack sudo[110957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf Jun 29 11:23:37 devstack sudo[110957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:38 devstack sudo[110957]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf" returned: 0 in 0.819s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:38 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] <== create_volume: return (1901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:23:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:23:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c499328d-71cf-46d4-85e0-6e5a0a92853e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5028f72-8569-4b03-aa99-e8087f7f0daf', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce39a312-e280-4112-bd95-406bd78eb26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:38 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] Volume volume-f5028f72-8569-4b03-aa99-e8087f7f0daf (f5028f72-8569-4b03-aa99-e8087f7f0daf): created successfully Jun 29 11:23:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce39a312-e280-4112-bd95-406bd78eb26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] Flow 'volume_create_manager' (dd21af8d-7c0d-449b-b201-b66697784620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:23:38 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-67896f8a-a65c-4c2f-8792-12aaad4b6789 tempest-TestStampPattern-2118674922 None] Created volume successfully. Jun 29 11:23:39 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:23:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] Flow 'volume_create_manager' (6ec1c60c-36d8-4baf-837f-02a66799e56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:23:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a1216ed-febf-469e-a26c-b93fcd50ef08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a1216ed-febf-469e-a26c-b93fcd50ef08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-274337592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8690db3f-08ff-424a-b5a9-178bdc2bd689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184c31dfaa074cb6941259b77e7c5f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:23:40Z,use_quota=True,user_id='338bfea81acd44ec889045f359ca40fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c786fbb-dc59-43ac-a5c0-4b92626900c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c786fbb-dc59-43ac-a5c0-4b92626900c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de904cce-dcf4-4a9c-be4a-f86a7c99e769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de904cce-dcf4-4a9c-be4a-f86a7c99e769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8690db3f-08ff-424a-b5a9-178bdc2bd689', 'volume_name': 'volume-8690db3f-08ff-424a-b5a9-178bdc2bd689', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e6521a6-5f60-4be9-90ef-ddfbdbcca500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e6521a6-5f60-4be9-90ef-ddfbdbcca500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f5b14e-5938-4da7-9ca0-331a5333989f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:39 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] Volume 8690db3f-08ff-424a-b5a9-178bdc2bd689: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8690db3f-08ff-424a-b5a9-178bdc2bd689', 'volume_size': 1} Jun 29 11:23:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:23:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:23:39 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-274337592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8690db3f-08ff-424a-b5a9-178bdc2bd689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184c31dfaa074cb6941259b77e7c5f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:23:40Z,use_quota=True,user_id='338bfea81acd44ec889045f359ca40fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:23:39 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] Creating volume 8690db3f-08ff-424a-b5a9-178bdc2bd689 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:23:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:23:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:23:39 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:23:39 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:23:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:23:39 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:23:39 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:23:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8690db3f-08ff-424a-b5a9-178bdc2bd689 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:39 devstack sudo[110961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8690db3f-08ff-424a-b5a9-178bdc2bd689 1073741824 Jun 29 11:23:39 devstack sudo[110961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:40 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:23:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] Flow 'volume_create_manager' (43867c28-dc86-4517-b6ed-e6e85e5da8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:23:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c959dafa-80b9-403c-abb3-92920aeaf8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c959dafa-80b9-403c-abb3-92920aeaf8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-887591631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7230919-362a-471a-b232-f96321ac781a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184c31dfaa074cb6941259b77e7c5f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:23:40Z,use_quota=True,user_id='338bfea81acd44ec889045f359ca40fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7a5486-9dd5-4aff-9f03-c2b4a726fc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7a5486-9dd5-4aff-9f03-c2b4a726fc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (760c71b9-c3be-46e1-9088-cf207fa2e3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (760c71b9-c3be-46e1-9088-cf207fa2e3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7230919-362a-471a-b232-f96321ac781a', 'volume_name': 'volume-b7230919-362a-471a-b232-f96321ac781a', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f530d5-7ba2-4113-bb20-35db3169c209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f530d5-7ba2-4113-bb20-35db3169c209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (977379b6-4f52-4ad8-ac1e-2f882c4be3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:40 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] Volume b7230919-362a-471a-b232-f96321ac781a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7230919-362a-471a-b232-f96321ac781a', 'volume_size': 1} Jun 29 11:23:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:23:40 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:23:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] Flow 'volume_create_manager' (c51d7337-8b8a-41af-a3d9-42c8ef94cff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:23:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704ec308-6f58-4a53-aa8e-c8acfceb9001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704ec308-6f58-4a53-aa8e-c8acfceb9001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-55032542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=211564ff-0baa-44cd-bee6-014c97c29894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184c31dfaa074cb6941259b77e7c5f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:23:40Z,use_quota=True,user_id='338bfea81acd44ec889045f359ca40fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28a7333a-0bc1-4859-b333-e377c781b3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28a7333a-0bc1-4859-b333-e377c781b3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9179ea67-8b9c-4afe-81c5-68616cf49822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9179ea67-8b9c-4afe-81c5-68616cf49822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '211564ff-0baa-44cd-bee6-014c97c29894', 'volume_name': 'volume-211564ff-0baa-44cd-bee6-014c97c29894', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1cbddb2-ee25-4d9a-84a1-6d798456162b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1cbddb2-ee25-4d9a-84a1-6d798456162b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29be9e1e-df8c-4296-8cb1-694da0b9e6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:40 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] Volume 211564ff-0baa-44cd-bee6-014c97c29894: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-211564ff-0baa-44cd-bee6-014c97c29894', 'volume_size': 1} Jun 29 11:23:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:23:40 devstack sudo[110961]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8690db3f-08ff-424a-b5a9-178bdc2bd689 1073741824" returned: 0 in 0.973s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8690db3f-08ff-424a-b5a9-178bdc2bd689 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:40 devstack sudo[110969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8690db3f-08ff-424a-b5a9-178bdc2bd689 Jun 29 11:23:40 devstack sudo[110969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] Flow 'volume_create_manager' (c5238e12-8d5e-4409-bb95-ba94d084e474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f018c5-126a-423a-aaf5-a184c3079aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f018c5-126a-423a-aaf5-a184c3079aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2139420519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f45eb5a5-08bb-4cea-b9e1-7b242f63b03f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184c31dfaa074cb6941259b77e7c5f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:23:41Z,use_quota=True,user_id='338bfea81acd44ec889045f359ca40fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a12ceb3-5ef4-49cd-97f6-d50974008e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a12ceb3-5ef4-49cd-97f6-d50974008e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e47c1af7-de1b-408a-9e14-03b31b075f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e47c1af7-de1b-408a-9e14-03b31b075f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f45eb5a5-08bb-4cea-b9e1-7b242f63b03f', 'volume_name': 'volume-f45eb5a5-08bb-4cea-b9e1-7b242f63b03f', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efe7a1a2-f127-40c4-99f5-4cd1593d9c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efe7a1a2-f127-40c4-99f5-4cd1593d9c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95a5c874-7046-4353-b4bc-d1ec605836eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:41 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] Volume f45eb5a5-08bb-4cea-b9e1-7b242f63b03f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f45eb5a5-08bb-4cea-b9e1-7b242f63b03f', 'volume_size': 1} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] Flow 'volume_create_manager' (44854a84-1386-441d-b49a-eb6e1946700f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c61a924e-c77e-493b-af97-70ce40c9f68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c61a924e-c77e-493b-af97-70ce40c9f68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1338764431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed1902e-75b4-4241-9e1f-3c8f817a21ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184c31dfaa074cb6941259b77e7c5f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:23:41Z,use_quota=True,user_id='338bfea81acd44ec889045f359ca40fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd7064c8-9ebc-4d6d-90a0-fe7efec5393a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd7064c8-9ebc-4d6d-90a0-fe7efec5393a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (052c7570-1d59-4a64-b265-9cfadf6e6c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (052c7570-1d59-4a64-b265-9cfadf6e6c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ed1902e-75b4-4241-9e1f-3c8f817a21ed', 'volume_name': 'volume-1ed1902e-75b4-4241-9e1f-3c8f817a21ed', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7694d55e-f25b-4e8e-be32-4b25211706e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7694d55e-f25b-4e8e-be32-4b25211706e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8304d932-63e7-4e75-8f22-d8d771134415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:41 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] Volume 1ed1902e-75b4-4241-9e1f-3c8f817a21ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ed1902e-75b4-4241-9e1f-3c8f817a21ed', 'volume_size': 1} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:23:41 devstack sudo[110969]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8690db3f-08ff-424a-b5a9-178bdc2bd689" returned: 0 in 0.677s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.379s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-887591631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7230919-362a-471a-b232-f96321ac781a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184c31dfaa074cb6941259b77e7c5f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:23:40Z,use_quota=True,user_id='338bfea81acd44ec889045f359ca40fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] Creating volume b7230919-362a-471a-b232-f96321ac781a {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:23:41 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b7230919-362a-471a-b232-f96321ac781a 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f5b14e-5938-4da7-9ca0-331a5333989f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8690db3f-08ff-424a-b5a9-178bdc2bd689', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:41 devstack sudo[110972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b7230919-362a-471a-b232-f96321ac781a 1073741824 Jun 29 11:23:41 devstack sudo[110972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0237d0e0-d6e0-4ffc-a50c-f08863b55b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:41 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] Volume volume-8690db3f-08ff-424a-b5a9-178bdc2bd689 (8690db3f-08ff-424a-b5a9-178bdc2bd689): created successfully Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0237d0e0-d6e0-4ffc-a50c-f08863b55b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] Flow 'volume_create_manager' (6ec1c60c-36d8-4baf-837f-02a66799e56a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:23:41 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-d4a2b58f-0519-4eff-bf18-4c857f8ea287 tempest-CreateVolumesFromImageTest-1111847750 None] Created volume successfully. Jun 29 11:23:42 devstack sudo[110972]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b7230919-362a-471a-b232-f96321ac781a 1073741824" returned: 0 in 0.961s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b7230919-362a-471a-b232-f96321ac781a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:42 devstack sudo[110978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b7230919-362a-471a-b232-f96321ac781a Jun 29 11:23:42 devstack sudo[110978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:43 devstack sudo[110978]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b7230919-362a-471a-b232-f96321ac781a" returned: 0 in 0.752s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:43 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:23:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:23:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.711s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:23:43 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-55032542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=211564ff-0baa-44cd-bee6-014c97c29894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184c31dfaa074cb6941259b77e7c5f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:23:40Z,use_quota=True,user_id='338bfea81acd44ec889045f359ca40fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:23:43 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] Creating volume 211564ff-0baa-44cd-bee6-014c97c29894 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:23:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:23:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:23:43 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:23:43 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:23:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:23:43 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:23:43 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:23:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-211564ff-0baa-44cd-bee6-014c97c29894 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (977379b6-4f52-4ad8-ac1e-2f882c4be3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7230919-362a-471a-b232-f96321ac781a', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:43 devstack sudo[110981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-211564ff-0baa-44cd-bee6-014c97c29894 1073741824 Jun 29 11:23:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182d9132-f79e-4d7a-a41e-58f43ddb0703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:43 devstack sudo[110981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:43 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] Volume volume-b7230919-362a-471a-b232-f96321ac781a (b7230919-362a-471a-b232-f96321ac781a): created successfully Jun 29 11:23:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182d9132-f79e-4d7a-a41e-58f43ddb0703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] Flow 'volume_create_manager' (43867c28-dc86-4517-b6ed-e6e85e5da8ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:23:43 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-5caf9405-1211-4e51-b827-dcf8f45d4462 tempest-CreateVolumesFromImageTest-1111847750 None] Created volume successfully. Jun 29 11:23:44 devstack sudo[110981]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-211564ff-0baa-44cd-bee6-014c97c29894 1073741824" returned: 0 in 0.897s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-211564ff-0baa-44cd-bee6-014c97c29894 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:44 devstack sudo[110998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-211564ff-0baa-44cd-bee6-014c97c29894 Jun 29 11:23:44 devstack sudo[110998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:44 devstack sudo[110998]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-211564ff-0baa-44cd-bee6-014c97c29894" returned: 0 in 0.676s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:44 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:23:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:23:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.750s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:23:44 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2139420519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f45eb5a5-08bb-4cea-b9e1-7b242f63b03f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184c31dfaa074cb6941259b77e7c5f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:23:41Z,use_quota=True,user_id='338bfea81acd44ec889045f359ca40fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:23:44 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] Creating volume f45eb5a5-08bb-4cea-b9e1-7b242f63b03f {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:23:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:23:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:23:44 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:23:44 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:23:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:23:44 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:23:44 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:23:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f45eb5a5-08bb-4cea-b9e1-7b242f63b03f 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:44 devstack sudo[111006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f45eb5a5-08bb-4cea-b9e1-7b242f63b03f 1073741824 Jun 29 11:23:44 devstack sudo[111006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29be9e1e-df8c-4296-8cb1-694da0b9e6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-211564ff-0baa-44cd-bee6-014c97c29894', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55377d1b-36cc-4718-9390-0c89c8a7462a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:44 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] Volume volume-211564ff-0baa-44cd-bee6-014c97c29894 (211564ff-0baa-44cd-bee6-014c97c29894): created successfully Jun 29 11:23:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55377d1b-36cc-4718-9390-0c89c8a7462a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] Flow 'volume_create_manager' (c51d7337-8b8a-41af-a3d9-42c8ef94cff9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:23:44 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-762dec60-574a-4130-8b6c-a944d7597180 tempest-CreateVolumesFromImageTest-1111847750 None] Created volume successfully. Jun 29 11:23:45 devstack sudo[111006]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f45eb5a5-08bb-4cea-b9e1-7b242f63b03f 1073741824" returned: 0 in 0.829s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f45eb5a5-08bb-4cea-b9e1-7b242f63b03f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:45 devstack sudo[111013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f45eb5a5-08bb-4cea-b9e1-7b242f63b03f Jun 29 11:23:45 devstack sudo[111013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:46 devstack sudo[111013]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f45eb5a5-08bb-4cea-b9e1-7b242f63b03f" returned: 0 in 0.623s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:23:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:23:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.075s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:23:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1338764431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ed1902e-75b4-4241-9e1f-3c8f817a21ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='184c31dfaa074cb6941259b77e7c5f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:23:41Z,use_quota=True,user_id='338bfea81acd44ec889045f359ca40fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:23:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] Creating volume 1ed1902e-75b4-4241-9e1f-3c8f817a21ed {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:23:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:23:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:23:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:23:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:23:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:23:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:23:46 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:23:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed1902e-75b4-4241-9e1f-3c8f817a21ed 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95a5c874-7046-4353-b4bc-d1ec605836eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f45eb5a5-08bb-4cea-b9e1-7b242f63b03f', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:46 devstack sudo[111016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed1902e-75b4-4241-9e1f-3c8f817a21ed 1073741824 Jun 29 11:23:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01f39e1d-0172-45ad-8802-e00596ca8f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:46 devstack sudo[111016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:46 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] Volume volume-f45eb5a5-08bb-4cea-b9e1-7b242f63b03f (f45eb5a5-08bb-4cea-b9e1-7b242f63b03f): created successfully Jun 29 11:23:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01f39e1d-0172-45ad-8802-e00596ca8f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] Flow 'volume_create_manager' (c5238e12-8d5e-4409-bb95-ba94d084e474) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:23:46 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-72dbc4ae-a05d-4104-926a-0d7c382fd9f0 tempest-CreateVolumesFromImageTest-1111847750 None] Created volume successfully. Jun 29 11:23:47 devstack sudo[111016]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed1902e-75b4-4241-9e1f-3c8f817a21ed 1073741824" returned: 0 in 0.828s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed1902e-75b4-4241-9e1f-3c8f817a21ed {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:47 devstack sudo[111022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed1902e-75b4-4241-9e1f-3c8f817a21ed Jun 29 11:23:47 devstack sudo[111022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:47 devstack sudo[111022]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed1902e-75b4-4241-9e1f-3c8f817a21ed" returned: 0 in 0.646s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:23:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:23:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8304d932-63e7-4e75-8f22-d8d771134415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ed1902e-75b4-4241-9e1f-3c8f817a21ed', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e995413a-2946-4b06-8cf8-3a4b326a1231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:23:47 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] Volume volume-1ed1902e-75b4-4241-9e1f-3c8f817a21ed (1ed1902e-75b4-4241-9e1f-3c8f817a21ed): created successfully Jun 29 11:23:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e995413a-2946-4b06-8cf8-3a4b326a1231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:23:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] Flow 'volume_create_manager' (44854a84-1386-441d-b49a-eb6e1946700f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:23:47 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-5ce0d07b-9092-4d9a-b10b-463d03e1eedf tempest-CreateVolumesFromImageTest-1111847750 None] Created volume successfully. Jun 29 11:23:48 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-be959d21-370f-46c3-a9c3-f7dcd0f4372a tempest-CreateVolumesFromImageTest-1111847750 None] Acquiring lock "cinder-1ed1902e-75b4-4241-9e1f-3c8f817a21ed-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:23:48 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-be959d21-370f-46c3-a9c3-f7dcd0f4372a tempest-CreateVolumesFromImageTest-1111847750 None] Lock "cinder-1ed1902e-75b4-4241-9e1f-3c8f817a21ed-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:23:48 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-be959d21-370f-46c3-a9c3-f7dcd0f4372a tempest-CreateVolumesFromImageTest-1111847750 None] Acquiring lock "cinder-quobyte-1ed1902e-75b4-4241-9e1f-3c8f817a21ed" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:23:48 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-be959d21-370f-46c3-a9c3-f7dcd0f4372a tempest-CreateVolumesFromImageTest-1111847750 None] Lock "cinder-quobyte-1ed1902e-75b4-4241-9e1f-3c8f817a21ed" acquired by "delete_volume" :: waited 0.016s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:23:48 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a0f775-5bfe-496c-a725-2cde4e2f9961]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:23:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-be959d21-370f-46c3-a9c3-f7dcd0f4372a tempest-CreateVolumesFromImageTest-1111847750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed1902e-75b4-4241-9e1f-3c8f817a21ed {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:49 devstack sudo[111035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed1902e-75b4-4241-9e1f-3c8f817a21ed Jun 29 11:23:49 devstack sudo[111035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:49 devstack sudo[111035]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-be959d21-370f-46c3-a9c3-f7dcd0f4372a tempest-CreateVolumesFromImageTest-1111847750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed1902e-75b4-4241-9e1f-3c8f817a21ed" returned: 0 in 0.985s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-be959d21-370f-46c3-a9c3-f7dcd0f4372a tempest-CreateVolumesFromImageTest-1111847750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed1902e-75b4-4241-9e1f-3c8f817a21ed {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:49 devstack sudo[111093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed1902e-75b4-4241-9e1f-3c8f817a21ed Jun 29 11:23:49 devstack sudo[111093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:50 devstack sudo[111093]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-be959d21-370f-46c3-a9c3-f7dcd0f4372a tempest-CreateVolumesFromImageTest-1111847750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-1ed1902e-75b4-4241-9e1f-3c8f817a21ed" returned: 0 in 0.840s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:50 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-be959d21-370f-46c3-a9c3-f7dcd0f4372a tempest-CreateVolumesFromImageTest-1111847750 None] Lock "cinder-quobyte-1ed1902e-75b4-4241-9e1f-3c8f817a21ed" released by "delete_volume" :: held 1.877s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:23:50 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-be959d21-370f-46c3-a9c3-f7dcd0f4372a tempest-CreateVolumesFromImageTest-1111847750 None] Created reservations ['c7e64703-3535-4adf-a118-857a69699a59', '55ffb815-28dc-4627-b352-e10e15623e19', '868d6331-9fe8-43fc-a987-1bea05810217', '174ea4fa-f6f6-4a42-8d73-ad1205a6180d'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:23:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-be959d21-370f-46c3-a9c3-f7dcd0f4372a tempest-CreateVolumesFromImageTest-1111847750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:23:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-be959d21-370f-46c3-a9c3-f7dcd0f4372a tempest-CreateVolumesFromImageTest-1111847750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:23:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-be959d21-370f-46c3-a9c3-f7dcd0f4372a tempest-CreateVolumesFromImageTest-1111847750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:23:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-be959d21-370f-46c3-a9c3-f7dcd0f4372a tempest-CreateVolumesFromImageTest-1111847750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:23:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-be959d21-370f-46c3-a9c3-f7dcd0f4372a tempest-CreateVolumesFromImageTest-1111847750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:23:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-be959d21-370f-46c3-a9c3-f7dcd0f4372a tempest-CreateVolumesFromImageTest-1111847750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:50 devstack sudo[111118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:23:50 devstack sudo[111118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:51 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f2bd665e-d040-4c83-ad92-f4e14edbec07 tempest-CreateVolumesFromImageTest-1111847750 None] Acquiring lock "cinder-f45eb5a5-08bb-4cea-b9e1-7b242f63b03f-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:23:51 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f2bd665e-d040-4c83-ad92-f4e14edbec07 tempest-CreateVolumesFromImageTest-1111847750 None] Lock "cinder-f45eb5a5-08bb-4cea-b9e1-7b242f63b03f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:23:51 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f2bd665e-d040-4c83-ad92-f4e14edbec07 tempest-CreateVolumesFromImageTest-1111847750 None] Acquiring lock "cinder-quobyte-f45eb5a5-08bb-4cea-b9e1-7b242f63b03f" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:23:51 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f2bd665e-d040-4c83-ad92-f4e14edbec07 tempest-CreateVolumesFromImageTest-1111847750 None] Lock "cinder-quobyte-f45eb5a5-08bb-4cea-b9e1-7b242f63b03f" acquired by "delete_volume" :: waited 0.030s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:23:51 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[176bdb6e-8f33-4d16-9b0f-86d9404b1816]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:23:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f2bd665e-d040-4c83-ad92-f4e14edbec07 tempest-CreateVolumesFromImageTest-1111847750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f45eb5a5-08bb-4cea-b9e1-7b242f63b03f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:51 devstack sudo[111121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f45eb5a5-08bb-4cea-b9e1-7b242f63b03f Jun 29 11:23:51 devstack sudo[111121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:51 devstack sudo[111118]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-be959d21-370f-46c3-a9c3-f7dcd0f4372a tempest-CreateVolumesFromImageTest-1111847750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.771s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:51 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-be959d21-370f-46c3-a9c3-f7dcd0f4372a tempest-CreateVolumesFromImageTest-1111847750 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:23:51 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-be959d21-370f-46c3-a9c3-f7dcd0f4372a tempest-CreateVolumesFromImageTest-1111847750 None] Deleted volume successfully. Jun 29 11:23:51 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-be959d21-370f-46c3-a9c3-f7dcd0f4372a tempest-CreateVolumesFromImageTest-1111847750 None] Lock "cinder-1ed1902e-75b4-4241-9e1f-3c8f817a21ed-delete_volume" released by "delete_volume" :: held 2.882s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:23:52 devstack sudo[111121]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f2bd665e-d040-4c83-ad92-f4e14edbec07 tempest-CreateVolumesFromImageTest-1111847750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f45eb5a5-08bb-4cea-b9e1-7b242f63b03f" returned: 0 in 0.925s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f2bd665e-d040-4c83-ad92-f4e14edbec07 tempest-CreateVolumesFromImageTest-1111847750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f45eb5a5-08bb-4cea-b9e1-7b242f63b03f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:52 devstack sudo[111127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f45eb5a5-08bb-4cea-b9e1-7b242f63b03f Jun 29 11:23:52 devstack sudo[111127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:52 devstack sudo[111127]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f2bd665e-d040-4c83-ad92-f4e14edbec07 tempest-CreateVolumesFromImageTest-1111847750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f45eb5a5-08bb-4cea-b9e1-7b242f63b03f" returned: 0 in 0.718s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:52 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f2bd665e-d040-4c83-ad92-f4e14edbec07 tempest-CreateVolumesFromImageTest-1111847750 None] Lock "cinder-quobyte-f45eb5a5-08bb-4cea-b9e1-7b242f63b03f" released by "delete_volume" :: held 1.703s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:23:53 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-f2bd665e-d040-4c83-ad92-f4e14edbec07 tempest-CreateVolumesFromImageTest-1111847750 None] Created reservations ['e00b8eac-fe7b-47d3-8148-ac553c1026ae', '1d27e819-7b12-4d73-867a-33118f84227f', '879325e2-debd-4a50-8587-47fc101c7a6c', 'b3ec5d19-a99b-4ae5-9dce-28f298851ba3'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:23:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f2bd665e-d040-4c83-ad92-f4e14edbec07 tempest-CreateVolumesFromImageTest-1111847750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:23:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f2bd665e-d040-4c83-ad92-f4e14edbec07 tempest-CreateVolumesFromImageTest-1111847750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:23:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f2bd665e-d040-4c83-ad92-f4e14edbec07 tempest-CreateVolumesFromImageTest-1111847750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:23:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f2bd665e-d040-4c83-ad92-f4e14edbec07 tempest-CreateVolumesFromImageTest-1111847750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:23:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f2bd665e-d040-4c83-ad92-f4e14edbec07 tempest-CreateVolumesFromImageTest-1111847750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:23:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f2bd665e-d040-4c83-ad92-f4e14edbec07 tempest-CreateVolumesFromImageTest-1111847750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:53 devstack sudo[111130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:23:53 devstack sudo[111130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:53 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-92e7c59c-cf37-4a4f-abef-007323385cde tempest-CreateVolumesFromImageTest-1111847750 None] Acquiring lock "cinder-211564ff-0baa-44cd-bee6-014c97c29894-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:23:53 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-92e7c59c-cf37-4a4f-abef-007323385cde tempest-CreateVolumesFromImageTest-1111847750 None] Lock "cinder-211564ff-0baa-44cd-bee6-014c97c29894-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:23:53 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-92e7c59c-cf37-4a4f-abef-007323385cde tempest-CreateVolumesFromImageTest-1111847750 None] Acquiring lock "cinder-quobyte-211564ff-0baa-44cd-bee6-014c97c29894" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:23:53 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-92e7c59c-cf37-4a4f-abef-007323385cde tempest-CreateVolumesFromImageTest-1111847750 None] Lock "cinder-quobyte-211564ff-0baa-44cd-bee6-014c97c29894" acquired by "delete_volume" :: waited 0.019s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:23:53 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a429cf-a3c5-4e4b-ab7c-496acf4354b1]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:23:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-92e7c59c-cf37-4a4f-abef-007323385cde tempest-CreateVolumesFromImageTest-1111847750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-211564ff-0baa-44cd-bee6-014c97c29894 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:53 devstack sudo[111132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-211564ff-0baa-44cd-bee6-014c97c29894 Jun 29 11:23:53 devstack sudo[111132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:53 devstack sudo[111130]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f2bd665e-d040-4c83-ad92-f4e14edbec07 tempest-CreateVolumesFromImageTest-1111847750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.739s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:53 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-f2bd665e-d040-4c83-ad92-f4e14edbec07 tempest-CreateVolumesFromImageTest-1111847750 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:23:53 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-f2bd665e-d040-4c83-ad92-f4e14edbec07 tempest-CreateVolumesFromImageTest-1111847750 None] Deleted volume successfully. Jun 29 11:23:53 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f2bd665e-d040-4c83-ad92-f4e14edbec07 tempest-CreateVolumesFromImageTest-1111847750 None] Lock "cinder-f45eb5a5-08bb-4cea-b9e1-7b242f63b03f-delete_volume" released by "delete_volume" :: held 2.718s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:23:54 devstack sudo[111132]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-92e7c59c-cf37-4a4f-abef-007323385cde tempest-CreateVolumesFromImageTest-1111847750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-211564ff-0baa-44cd-bee6-014c97c29894" returned: 0 in 0.845s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-92e7c59c-cf37-4a4f-abef-007323385cde tempest-CreateVolumesFromImageTest-1111847750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-211564ff-0baa-44cd-bee6-014c97c29894 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:54 devstack sudo[111138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-211564ff-0baa-44cd-bee6-014c97c29894 Jun 29 11:23:54 devstack sudo[111138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:55 devstack sudo[111138]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-92e7c59c-cf37-4a4f-abef-007323385cde tempest-CreateVolumesFromImageTest-1111847750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-211564ff-0baa-44cd-bee6-014c97c29894" returned: 0 in 0.662s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-92e7c59c-cf37-4a4f-abef-007323385cde tempest-CreateVolumesFromImageTest-1111847750 None] Lock "cinder-quobyte-211564ff-0baa-44cd-bee6-014c97c29894" released by "delete_volume" :: held 1.562s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:23:55 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-92e7c59c-cf37-4a4f-abef-007323385cde tempest-CreateVolumesFromImageTest-1111847750 None] Created reservations ['0131758b-1f2e-415e-a94c-b2e48c076cde', 'dc6f3723-d06f-4902-a699-1cf6ed342fc6', '0343042a-8116-407f-bc40-1e80dc3acf6f', '7ee2467f-4a44-4d3b-bce3-54b06d64555a'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:23:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-92e7c59c-cf37-4a4f-abef-007323385cde tempest-CreateVolumesFromImageTest-1111847750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:23:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-92e7c59c-cf37-4a4f-abef-007323385cde tempest-CreateVolumesFromImageTest-1111847750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:23:55 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-92e7c59c-cf37-4a4f-abef-007323385cde tempest-CreateVolumesFromImageTest-1111847750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:23:55 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-92e7c59c-cf37-4a4f-abef-007323385cde tempest-CreateVolumesFromImageTest-1111847750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:23:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-92e7c59c-cf37-4a4f-abef-007323385cde tempest-CreateVolumesFromImageTest-1111847750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:23:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-92e7c59c-cf37-4a4f-abef-007323385cde tempest-CreateVolumesFromImageTest-1111847750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:55 devstack sudo[111155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:23:55 devstack sudo[111155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3014d6b3-c2ab-4fa2-b54e-d6101095f1a6 tempest-CreateVolumesFromImageTest-1111847750 None] Acquiring lock "cinder-b7230919-362a-471a-b232-f96321ac781a-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:23:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3014d6b3-c2ab-4fa2-b54e-d6101095f1a6 tempest-CreateVolumesFromImageTest-1111847750 None] Lock "cinder-b7230919-362a-471a-b232-f96321ac781a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:23:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3014d6b3-c2ab-4fa2-b54e-d6101095f1a6 tempest-CreateVolumesFromImageTest-1111847750 None] Acquiring lock "cinder-quobyte-b7230919-362a-471a-b232-f96321ac781a" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:23:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3014d6b3-c2ab-4fa2-b54e-d6101095f1a6 tempest-CreateVolumesFromImageTest-1111847750 None] Lock "cinder-quobyte-b7230919-362a-471a-b232-f96321ac781a" acquired by "delete_volume" :: waited 0.027s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:23:55 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[59dba355-7159-460e-9e26-e91b35e462ff]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:23:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3014d6b3-c2ab-4fa2-b54e-d6101095f1a6 tempest-CreateVolumesFromImageTest-1111847750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b7230919-362a-471a-b232-f96321ac781a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:56 devstack sudo[111179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b7230919-362a-471a-b232-f96321ac781a Jun 29 11:23:56 devstack sudo[111179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:56 devstack sudo[111155]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-92e7c59c-cf37-4a4f-abef-007323385cde tempest-CreateVolumesFromImageTest-1111847750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.092s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:56 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-92e7c59c-cf37-4a4f-abef-007323385cde tempest-CreateVolumesFromImageTest-1111847750 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:23:56 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-92e7c59c-cf37-4a4f-abef-007323385cde tempest-CreateVolumesFromImageTest-1111847750 None] Deleted volume successfully. Jun 29 11:23:56 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-92e7c59c-cf37-4a4f-abef-007323385cde tempest-CreateVolumesFromImageTest-1111847750 None] Lock "cinder-211564ff-0baa-44cd-bee6-014c97c29894-delete_volume" released by "delete_volume" :: held 2.900s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:23:56 devstack sudo[111179]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3014d6b3-c2ab-4fa2-b54e-d6101095f1a6 tempest-CreateVolumesFromImageTest-1111847750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b7230919-362a-471a-b232-f96321ac781a" returned: 0 in 0.961s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3014d6b3-c2ab-4fa2-b54e-d6101095f1a6 tempest-CreateVolumesFromImageTest-1111847750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b7230919-362a-471a-b232-f96321ac781a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:56 devstack sudo[111188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b7230919-362a-471a-b232-f96321ac781a Jun 29 11:23:56 devstack sudo[111188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:57 devstack sudo[111188]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3014d6b3-c2ab-4fa2-b54e-d6101095f1a6 tempest-CreateVolumesFromImageTest-1111847750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-b7230919-362a-471a-b232-f96321ac781a" returned: 0 in 0.671s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:57 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3014d6b3-c2ab-4fa2-b54e-d6101095f1a6 tempest-CreateVolumesFromImageTest-1111847750 None] Lock "cinder-quobyte-b7230919-362a-471a-b232-f96321ac781a" released by "delete_volume" :: held 1.690s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:23:57 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-3014d6b3-c2ab-4fa2-b54e-d6101095f1a6 tempest-CreateVolumesFromImageTest-1111847750 None] Created reservations ['6356c9bd-a65c-411e-9adc-d0ca6a882763', '388e7d5e-c57e-4f33-a758-2c49b70ca3fb', '4a993462-78d9-45ab-b3f3-2f47aab34937', '08a75d29-138a-4880-93f2-837809e9e16b'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:23:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3014d6b3-c2ab-4fa2-b54e-d6101095f1a6 tempest-CreateVolumesFromImageTest-1111847750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:23:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3014d6b3-c2ab-4fa2-b54e-d6101095f1a6 tempest-CreateVolumesFromImageTest-1111847750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:23:57 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-3014d6b3-c2ab-4fa2-b54e-d6101095f1a6 tempest-CreateVolumesFromImageTest-1111847750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:23:57 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-3014d6b3-c2ab-4fa2-b54e-d6101095f1a6 tempest-CreateVolumesFromImageTest-1111847750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:23:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3014d6b3-c2ab-4fa2-b54e-d6101095f1a6 tempest-CreateVolumesFromImageTest-1111847750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:23:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3014d6b3-c2ab-4fa2-b54e-d6101095f1a6 tempest-CreateVolumesFromImageTest-1111847750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:57 devstack sudo[111192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:23:57 devstack sudo[111192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:57 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-7e3d6c7a-740e-4716-a509-c83d8a326e9b tempest-CreateVolumesFromImageTest-1111847750 None] Acquiring lock "cinder-8690db3f-08ff-424a-b5a9-178bdc2bd689-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:23:57 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-7e3d6c7a-740e-4716-a509-c83d8a326e9b tempest-CreateVolumesFromImageTest-1111847750 None] Lock "cinder-8690db3f-08ff-424a-b5a9-178bdc2bd689-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:23:58 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-7e3d6c7a-740e-4716-a509-c83d8a326e9b tempest-CreateVolumesFromImageTest-1111847750 None] Acquiring lock "cinder-quobyte-8690db3f-08ff-424a-b5a9-178bdc2bd689" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:23:58 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-7e3d6c7a-740e-4716-a509-c83d8a326e9b tempest-CreateVolumesFromImageTest-1111847750 None] Lock "cinder-quobyte-8690db3f-08ff-424a-b5a9-178bdc2bd689" acquired by "delete_volume" :: waited 0.016s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:23:58 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[766fcf30-a483-4539-88f1-bcdd14de2496]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:23:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e3d6c7a-740e-4716-a509-c83d8a326e9b tempest-CreateVolumesFromImageTest-1111847750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8690db3f-08ff-424a-b5a9-178bdc2bd689 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:58 devstack sudo[111194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8690db3f-08ff-424a-b5a9-178bdc2bd689 Jun 29 11:23:58 devstack sudo[111194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:58 devstack sudo[111192]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3014d6b3-c2ab-4fa2-b54e-d6101095f1a6 tempest-CreateVolumesFromImageTest-1111847750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.701s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:58 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-3014d6b3-c2ab-4fa2-b54e-d6101095f1a6 tempest-CreateVolumesFromImageTest-1111847750 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:23:58 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-3014d6b3-c2ab-4fa2-b54e-d6101095f1a6 tempest-CreateVolumesFromImageTest-1111847750 None] Deleted volume successfully. Jun 29 11:23:58 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3014d6b3-c2ab-4fa2-b54e-d6101095f1a6 tempest-CreateVolumesFromImageTest-1111847750 None] Lock "cinder-b7230919-362a-471a-b232-f96321ac781a-delete_volume" released by "delete_volume" :: held 2.654s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:23:58 devstack sudo[111194]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e3d6c7a-740e-4716-a509-c83d8a326e9b tempest-CreateVolumesFromImageTest-1111847750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8690db3f-08ff-424a-b5a9-178bdc2bd689" returned: 0 in 0.785s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e3d6c7a-740e-4716-a509-c83d8a326e9b tempest-CreateVolumesFromImageTest-1111847750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8690db3f-08ff-424a-b5a9-178bdc2bd689 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:58 devstack sudo[111200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8690db3f-08ff-424a-b5a9-178bdc2bd689 Jun 29 11:23:58 devstack sudo[111200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:23:59 devstack sudo[111200]: pam_unix(sudo:session): session closed for user root Jun 29 11:23:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e3d6c7a-740e-4716-a509-c83d8a326e9b tempest-CreateVolumesFromImageTest-1111847750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8690db3f-08ff-424a-b5a9-178bdc2bd689" returned: 0 in 0.634s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:23:59 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-7e3d6c7a-740e-4716-a509-c83d8a326e9b tempest-CreateVolumesFromImageTest-1111847750 None] Lock "cinder-quobyte-8690db3f-08ff-424a-b5a9-178bdc2bd689" released by "delete_volume" :: held 1.467s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:23:59 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-7e3d6c7a-740e-4716-a509-c83d8a326e9b tempest-CreateVolumesFromImageTest-1111847750 None] Created reservations ['64f77be6-dd35-424a-b4a3-34e6bba091b0', 'c8e8e9de-e607-4558-bc3a-e9be1da7519c', '5d93344a-284a-4af3-ba94-ce71256aac78', '1f983679-c225-41a3-a460-461226bfd092'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:23:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7e3d6c7a-740e-4716-a509-c83d8a326e9b tempest-CreateVolumesFromImageTest-1111847750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:23:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7e3d6c7a-740e-4716-a509-c83d8a326e9b tempest-CreateVolumesFromImageTest-1111847750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:23:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7e3d6c7a-740e-4716-a509-c83d8a326e9b tempest-CreateVolumesFromImageTest-1111847750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:23:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7e3d6c7a-740e-4716-a509-c83d8a326e9b tempest-CreateVolumesFromImageTest-1111847750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:23:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7e3d6c7a-740e-4716-a509-c83d8a326e9b tempest-CreateVolumesFromImageTest-1111847750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:23:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e3d6c7a-740e-4716-a509-c83d8a326e9b tempest-CreateVolumesFromImageTest-1111847750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:23:59 devstack sudo[111203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:23:59 devstack sudo[111203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:00 devstack sudo[111203]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e3d6c7a-740e-4716-a509-c83d8a326e9b tempest-CreateVolumesFromImageTest-1111847750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.638s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:00 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-7e3d6c7a-740e-4716-a509-c83d8a326e9b tempest-CreateVolumesFromImageTest-1111847750 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:24:00 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-7e3d6c7a-740e-4716-a509-c83d8a326e9b tempest-CreateVolumesFromImageTest-1111847750 None] Deleted volume successfully. Jun 29 11:24:00 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-7e3d6c7a-740e-4716-a509-c83d8a326e9b tempest-CreateVolumesFromImageTest-1111847750 None] Lock "cinder-8690db3f-08ff-424a-b5a9-178bdc2bd689-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:24:03 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:24:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Flow 'volume_create_manager' (229065a9-6471-47b5-be54-78d027fe44ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:24:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8e7510b-5223-4f39-9434-496ff6605ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8e7510b-5223-4f39-9434-496ff6605ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-113995210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17dd78c1-9274-4067-aa6f-b2ffd8a673c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d3bafd5d4e14c71803a3a4aa3fbd475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:24:03Z,use_quota=True,user_id='7b0fff628b784692b74f4746a1b7ea18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (047d1d84-cecf-4a94-a0f1-f9fe0d464ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (047d1d84-cecf-4a94-a0f1-f9fe0d464ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac69668d-d889-4965-964d-612101547bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac69668d-d889-4965-964d-612101547bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17dd78c1-9274-4067-aa6f-b2ffd8a673c4', 'volume_name': 'volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a12258-bbb5-4d69-b9d9-86d4c5d083a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a12258-bbb5-4d69-b9d9-86d4c5d083a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:03 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb79650-c074-4eb5-be94-ee7a69edc880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:03 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Volume 17dd78c1-9274-4067-aa6f-b2ffd8a673c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4', 'volume_size': 1} Jun 29 11:24:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:03 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-113995210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17dd78c1-9274-4067-aa6f-b2ffd8a673c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d3bafd5d4e14c71803a3a4aa3fbd475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:24:03Z,use_quota=True,user_id='7b0fff628b784692b74f4746a1b7ea18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:24:03 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Creating volume 17dd78c1-9274-4067-aa6f-b2ffd8a673c4 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:24:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:03 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:24:03 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:24:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:03 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:24:03 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:24:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:03 devstack sudo[111220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4 1073741824 Jun 29 11:24:03 devstack sudo[111220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:04 devstack sudo[111220]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4 1073741824" returned: 0 in 0.799s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:04 devstack sudo[111225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4 Jun 29 11:24:04 devstack sudo[111225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:04 devstack sudo[111225]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4" returned: 0 in 0.608s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:04 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:24:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:04 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb79650-c074-4eb5-be94-ee7a69edc880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:04 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61ca2b3c-7016-4f73-a258-2c700bf5237b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:04 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Volume volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4 (17dd78c1-9274-4067-aa6f-b2ffd8a673c4): created successfully Jun 29 11:24:04 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61ca2b3c-7016-4f73-a258-2c700bf5237b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:04 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Flow 'volume_create_manager' (229065a9-6471-47b5-be54-78d027fe44ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:24:04 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-ce499a7a-25bd-4dad-9d0d-4eb276d2ad92 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Created volume successfully. Jun 29 11:24:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3bfbcdfb-9fb9-4b8f-a3dc-de2c88d99ebd tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3bfbcdfb-9fb9-4b8f-a3dc-de2c88d99ebd tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:05 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-3bfbcdfb-9fb9-4b8f-a3dc-de2c88d99ebd tempest-CreateVolumesFromSnapshotTest-1297558146 None] Creating offline snapshot 2b9f27b7-79c5-4643-99d9-85c9f608c6f8 of volume 17dd78c1-9274-4067-aa6f-b2ffd8a673c4 {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:24:05 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e61cf3-66ae-4251-9903-832f6e244518]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:24:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3bfbcdfb-9fb9-4b8f-a3dc-de2c88d99ebd tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:05 devstack sudo[111228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4 Jun 29 11:24:05 devstack sudo[111228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:06 devstack sudo[111228]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3bfbcdfb-9fb9-4b8f-a3dc-de2c88d99ebd tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4" returned: 0 in 0.727s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3bfbcdfb-9fb9-4b8f-a3dc-de2c88d99ebd tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4.2b9f27b7-79c5-4643-99d9-85c9f608c6f8 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:06 devstack sudo[111233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4.2b9f27b7-79c5-4643-99d9-85c9f608c6f8 1G Jun 29 11:24:06 devstack sudo[111233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:06 devstack sudo[111233]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3bfbcdfb-9fb9-4b8f-a3dc-de2c88d99ebd tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4.2b9f27b7-79c5-4643-99d9-85c9f608c6f8 1G" returned: 0 in 0.801s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3bfbcdfb-9fb9-4b8f-a3dc-de2c88d99ebd tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4.2b9f27b7-79c5-4643-99d9-85c9f608c6f8 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:07 devstack sudo[111238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4.2b9f27b7-79c5-4643-99d9-85c9f608c6f8 Jun 29 11:24:07 devstack sudo[111238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:07 devstack sudo[111238]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3bfbcdfb-9fb9-4b8f-a3dc-de2c88d99ebd tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4.2b9f27b7-79c5-4643-99d9-85c9f608c6f8" returned: 0 in 0.667s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:07 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-3bfbcdfb-9fb9-4b8f-a3dc-de2c88d99ebd tempest-CreateVolumesFromSnapshotTest-1297558146 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4.2b9f27b7-79c5-4643-99d9-85c9f608c6f8 is being set with open permissions: ugo+rw Jun 29 11:24:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3bfbcdfb-9fb9-4b8f-a3dc-de2c88d99ebd tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4.2b9f27b7-79c5-4643-99d9-85c9f608c6f8 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:07 devstack sudo[111244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4.2b9f27b7-79c5-4643-99d9-85c9f608c6f8 Jun 29 11:24:07 devstack sudo[111244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:08 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:24:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:24:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:24:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:08 devstack sudo[111246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:24:08 devstack sudo[111246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:08 devstack sudo[111244]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3bfbcdfb-9fb9-4b8f-a3dc-de2c88d99ebd tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4.2b9f27b7-79c5-4643-99d9-85c9f608c6f8" returned: 0 in 0.619s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3bfbcdfb-9fb9-4b8f-a3dc-de2c88d99ebd tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:08 devstack sudo[111249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4.info Jun 29 11:24:08 devstack sudo[111249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:08 devstack sudo[111246]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.632s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:08 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:24:08 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager._thread_info {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:24:08 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread count: 29 {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 11:24:08 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread info: [<_MainThread(MainThread, started 131117520400512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 11:24:08 devstack sudo[111249]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3bfbcdfb-9fb9-4b8f-a3dc-de2c88d99ebd tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4.info" returned: 0 in 0.623s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:08 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-3bfbcdfb-9fb9-4b8f-a3dc-de2c88d99ebd tempest-CreateVolumesFromSnapshotTest-1297558146 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4.info is being set with open permissions: ugo+rw Jun 29 11:24:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3bfbcdfb-9fb9-4b8f-a3dc-de2c88d99ebd tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:08 devstack sudo[111253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4.info Jun 29 11:24:08 devstack sudo[111253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:09 devstack sudo[111253]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3bfbcdfb-9fb9-4b8f-a3dc-de2c88d99ebd tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4.info" returned: 0 in 0.617s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3bfbcdfb-9fb9-4b8f-a3dc-de2c88d99ebd tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.142s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:09 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-3bfbcdfb-9fb9-4b8f-a3dc-de2c88d99ebd tempest-CreateVolumesFromSnapshotTest-1297558146 None] Create snapshot completed successfully Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Flow 'volume_create_manager' (a5864b8e-17c1-4304-9fd4-25901c2ab282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d84cbaf9-bd62-4df8-ac25-9fe7d5f5fd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d84cbaf9-bd62-4df8-ac25-9fe7d5f5fd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1912235661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46662428-0e80-4794-9936-77abac3a392d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d3bafd5d4e14c71803a3a4aa3fbd475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:24:11Z,use_quota=True,user_id='7b0fff628b784692b74f4746a1b7ea18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07091980-3d13-4c37-a3b6-1d48a16f1fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07091980-3d13-4c37-a3b6-1d48a16f1fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b6023b8-5b8c-4440-b95a-6d0b02b78bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b6023b8-5b8c-4440-b95a-6d0b02b78bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46662428-0e80-4794-9936-77abac3a392d', 'volume_name': 'volume-46662428-0e80-4794-9936-77abac3a392d', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547f02ea-01f7-40e0-bbf7-69aad3d089db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547f02ea-01f7-40e0-bbf7-69aad3d089db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7fc0769-07b0-40fe-9950-faa3af779095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:11 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Volume 46662428-0e80-4794-9936-77abac3a392d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46662428-0e80-4794-9936-77abac3a392d', 'volume_size': 1} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1912235661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46662428-0e80-4794-9936-77abac3a392d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d3bafd5d4e14c71803a3a4aa3fbd475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:24:11Z,use_quota=True,user_id='7b0fff628b784692b74f4746a1b7ea18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Creating volume 46662428-0e80-4794-9936-77abac3a392d {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:24:11 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-46662428-0e80-4794-9936-77abac3a392d 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:11 devstack sudo[111256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-46662428-0e80-4794-9936-77abac3a392d 1073741824 Jun 29 11:24:11 devstack sudo[111256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Flow 'volume_create_manager' (1a1813e6-7e1f-4127-90e0-bd4590ec4736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f343541-ee05-4c48-b658-4d9a9fa8870f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f343541-ee05-4c48-b658-4d9a9fa8870f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1799871151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=185e97d6-8414-4b25-b5c0-21faad963448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d3bafd5d4e14c71803a3a4aa3fbd475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:24:12Z,use_quota=True,user_id='7b0fff628b784692b74f4746a1b7ea18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4349ae1-b7fa-4270-a69a-4aef423004da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4349ae1-b7fa-4270-a69a-4aef423004da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8977e85a-ce67-47bf-b1c8-44c007342151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8977e85a-ce67-47bf-b1c8-44c007342151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '185e97d6-8414-4b25-b5c0-21faad963448', 'volume_name': 'volume-185e97d6-8414-4b25-b5c0-21faad963448', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32767388-c512-4335-b758-8d680f064247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32767388-c512-4335-b758-8d680f064247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab816e7c-c632-4284-9cea-4e76424030d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:11 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Volume 185e97d6-8414-4b25-b5c0-21faad963448: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-185e97d6-8414-4b25-b5c0-21faad963448', 'volume_size': 1} Jun 29 11:24:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:12 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:24:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Flow 'volume_create_manager' (195261ef-d8f3-4599-9b2c-d938b12a86bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:24:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df0d78d-5036-4e50-8a3b-0ef017975b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df0d78d-5036-4e50-8a3b-0ef017975b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-265667978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5650354f-51cb-4b1c-a8ac-616f1958a19e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d3bafd5d4e14c71803a3a4aa3fbd475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:24:12Z,use_quota=True,user_id='7b0fff628b784692b74f4746a1b7ea18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cbbf815-3250-40d5-95da-2e950eb1cab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cbbf815-3250-40d5-95da-2e950eb1cab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b55570e-0c61-4924-90e5-b4433677af4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b55570e-0c61-4924-90e5-b4433677af4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5650354f-51cb-4b1c-a8ac-616f1958a19e', 'volume_name': 'volume-5650354f-51cb-4b1c-a8ac-616f1958a19e', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e887386-fa9f-4bea-94c4-977984363e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e887386-fa9f-4bea-94c4-977984363e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad0b745-3c89-494b-9808-53b08a3dbd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:12 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Volume 5650354f-51cb-4b1c-a8ac-616f1958a19e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5650354f-51cb-4b1c-a8ac-616f1958a19e', 'volume_size': 1} Jun 29 11:24:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:12 devstack sudo[111256]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-46662428-0e80-4794-9936-77abac3a392d 1073741824" returned: 0 in 1.082s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-46662428-0e80-4794-9936-77abac3a392d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:12 devstack sudo[111263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-46662428-0e80-4794-9936-77abac3a392d Jun 29 11:24:12 devstack sudo[111263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:12 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:24:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Flow 'volume_create_manager' (8ff8c491-9f65-4803-b6a7-53cc63f50f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:24:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c6dc05c-3c88-404d-893b-7f395ef219a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c6dc05c-3c88-404d-893b-7f395ef219a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1769248800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0079d0f-3f6c-4688-b8f7-736505bf43b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d3bafd5d4e14c71803a3a4aa3fbd475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:24:12Z,use_quota=True,user_id='7b0fff628b784692b74f4746a1b7ea18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39093b2f-f6b5-4237-a46e-e35ee1aefa68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39093b2f-f6b5-4237-a46e-e35ee1aefa68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29aca69d-900d-4b4f-ab12-ecd0eddbdfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29aca69d-900d-4b4f-ab12-ecd0eddbdfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0079d0f-3f6c-4688-b8f7-736505bf43b2', 'volume_name': 'volume-a0079d0f-3f6c-4688-b8f7-736505bf43b2', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07aaf6c1-5495-47cc-9c33-afc9afbf0542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07aaf6c1-5495-47cc-9c33-afc9afbf0542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:12 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f3e758-2238-490b-9f6c-f2ec662b8147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:12 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Volume a0079d0f-3f6c-4688-b8f7-736505bf43b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0079d0f-3f6c-4688-b8f7-736505bf43b2', 'volume_size': 1} Jun 29 11:24:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:13 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:24:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Flow 'volume_create_manager' (b44dfe7f-d075-4dee-b1bc-5fd14eaec5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:24:13 devstack sudo[111263]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5981a33c-ac75-42e3-a0be-ec644e3759b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-46662428-0e80-4794-9936-77abac3a392d" returned: 0 in 0.778s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:13 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:24:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.910s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.221s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:13 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1799871151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=185e97d6-8414-4b25-b5c0-21faad963448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d3bafd5d4e14c71803a3a4aa3fbd475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:24:12Z,use_quota=True,user_id='7b0fff628b784692b74f4746a1b7ea18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:24:13 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Creating volume 185e97d6-8414-4b25-b5c0-21faad963448 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:24:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:13 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:24:13 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:24:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:13 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:24:13 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:24:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-185e97d6-8414-4b25-b5c0-21faad963448 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5981a33c-ac75-42e3-a0be-ec644e3759b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-532835650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a920e4-2aa5-4adf-811e-e6497e4b2cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d3bafd5d4e14c71803a3a4aa3fbd475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:24:13Z,use_quota=True,user_id='7b0fff628b784692b74f4746a1b7ea18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (435f9998-ca3e-4b9e-8e13-0fc9ce5bf650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:13 devstack sudo[111266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-185e97d6-8414-4b25-b5c0-21faad963448 1073741824 Jun 29 11:24:13 devstack sudo[111266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (435f9998-ca3e-4b9e-8e13-0fc9ce5bf650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1b3295d-57af-4bf4-9fe8-f9de83b3ae6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1b3295d-57af-4bf4-9fe8-f9de83b3ae6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37a920e4-2aa5-4adf-811e-e6497e4b2cfc', 'volume_name': 'volume-37a920e4-2aa5-4adf-811e-e6497e4b2cfc', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (674dabb1-d10c-4dc4-9d87-228a0cd62cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (674dabb1-d10c-4dc4-9d87-228a0cd62cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (287123a4-68ab-4a39-a6fc-d8e3dced6384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:13 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Volume 37a920e4-2aa5-4adf-811e-e6497e4b2cfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37a920e4-2aa5-4adf-811e-e6497e4b2cfc', 'volume_size': 1} Jun 29 11:24:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7fc0769-07b0-40fe-9950-faa3af779095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46662428-0e80-4794-9936-77abac3a392d', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62f75131-5643-4391-a987-628b27d7285b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:13 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Volume volume-46662428-0e80-4794-9936-77abac3a392d (46662428-0e80-4794-9936-77abac3a392d): created successfully Jun 29 11:24:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62f75131-5643-4391-a987-628b27d7285b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:13 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Flow 'volume_create_manager' (a5864b8e-17c1-4304-9fd4-25901c2ab282) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:24:13 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-fd72484f-afcb-4ac3-85bd-312c4bdbca66 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Created volume successfully. Jun 29 11:24:13 devstack sudo[111266]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-185e97d6-8414-4b25-b5c0-21faad963448 1073741824" returned: 0 in 0.867s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-185e97d6-8414-4b25-b5c0-21faad963448 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:14 devstack sudo[111277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-185e97d6-8414-4b25-b5c0-21faad963448 Jun 29 11:24:14 devstack sudo[111277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:14 devstack sudo[111277]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-185e97d6-8414-4b25-b5c0-21faad963448" returned: 0 in 0.632s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:14 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:24:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.442s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:14 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-265667978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5650354f-51cb-4b1c-a8ac-616f1958a19e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d3bafd5d4e14c71803a3a4aa3fbd475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:24:12Z,use_quota=True,user_id='7b0fff628b784692b74f4746a1b7ea18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:24:14 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Creating volume 5650354f-51cb-4b1c-a8ac-616f1958a19e {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:24:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:14 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:24:14 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:24:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:14 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:24:14 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:24:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5650354f-51cb-4b1c-a8ac-616f1958a19e 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:14 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab816e7c-c632-4284-9cea-4e76424030d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-185e97d6-8414-4b25-b5c0-21faad963448', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:14 devstack sudo[111281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5650354f-51cb-4b1c-a8ac-616f1958a19e 1073741824 Jun 29 11:24:14 devstack sudo[111281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:14 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a78541a-9e77-477e-a5e5-8c5c15e6aad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:14 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Volume volume-185e97d6-8414-4b25-b5c0-21faad963448 (185e97d6-8414-4b25-b5c0-21faad963448): created successfully Jun 29 11:24:14 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a78541a-9e77-477e-a5e5-8c5c15e6aad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:14 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Flow 'volume_create_manager' (1a1813e6-7e1f-4127-90e0-bd4590ec4736) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:24:14 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-167d8097-0871-48e1-844f-ffe5362d20a7 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Created volume successfully. Jun 29 11:24:15 devstack sudo[111281]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5650354f-51cb-4b1c-a8ac-616f1958a19e 1073741824" returned: 0 in 0.857s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5650354f-51cb-4b1c-a8ac-616f1958a19e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:15 devstack sudo[111287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5650354f-51cb-4b1c-a8ac-616f1958a19e Jun 29 11:24:15 devstack sudo[111287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:16 devstack sudo[111287]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5650354f-51cb-4b1c-a8ac-616f1958a19e" returned: 0 in 0.652s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:16 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:24:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.564s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:16 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1769248800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0079d0f-3f6c-4688-b8f7-736505bf43b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d3bafd5d4e14c71803a3a4aa3fbd475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:24:12Z,use_quota=True,user_id='7b0fff628b784692b74f4746a1b7ea18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:24:16 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Creating volume a0079d0f-3f6c-4688-b8f7-736505bf43b2 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:24:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:16 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:24:16 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:24:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:16 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:24:16 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:24:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a0079d0f-3f6c-4688-b8f7-736505bf43b2 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad0b745-3c89-494b-9808-53b08a3dbd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5650354f-51cb-4b1c-a8ac-616f1958a19e', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2731cd0f-14e0-4c90-af1d-f1ff90fb76f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:16 devstack sudo[111294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a0079d0f-3f6c-4688-b8f7-736505bf43b2 1073741824 Jun 29 11:24:16 devstack sudo[111294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:16 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Volume volume-5650354f-51cb-4b1c-a8ac-616f1958a19e (5650354f-51cb-4b1c-a8ac-616f1958a19e): created successfully Jun 29 11:24:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2731cd0f-14e0-4c90-af1d-f1ff90fb76f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:16 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Flow 'volume_create_manager' (195261ef-d8f3-4599-9b2c-d938b12a86bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:24:16 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-5877e361-5869-4da2-ba20-c4740aa49372 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Created volume successfully. Jun 29 11:24:17 devstack sudo[111294]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a0079d0f-3f6c-4688-b8f7-736505bf43b2 1073741824" returned: 0 in 0.828s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a0079d0f-3f6c-4688-b8f7-736505bf43b2 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:17 devstack sudo[111299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a0079d0f-3f6c-4688-b8f7-736505bf43b2 Jun 29 11:24:17 devstack sudo[111299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:17 devstack sudo[111299]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a0079d0f-3f6c-4688-b8f7-736505bf43b2" returned: 0 in 0.635s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:24:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.578s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-532835650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a920e4-2aa5-4adf-811e-e6497e4b2cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d3bafd5d4e14c71803a3a4aa3fbd475',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:24:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:24:13Z,use_quota=True,user_id='7b0fff628b784692b74f4746a1b7ea18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:24:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Creating volume 37a920e4-2aa5-4adf-811e-e6497e4b2cfc {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:24:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:24:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:24:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:24:17 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:24:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-37a920e4-2aa5-4adf-811e-e6497e4b2cfc 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:17 devstack sudo[111303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-37a920e4-2aa5-4adf-811e-e6497e4b2cfc 1073741824 Jun 29 11:24:17 devstack sudo[111303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f3e758-2238-490b-9f6c-f2ec662b8147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0079d0f-3f6c-4688-b8f7-736505bf43b2', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15270264-c9dd-4c65-a241-a97081ee640e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:17 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Volume volume-a0079d0f-3f6c-4688-b8f7-736505bf43b2 (a0079d0f-3f6c-4688-b8f7-736505bf43b2): created successfully Jun 29 11:24:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15270264-c9dd-4c65-a241-a97081ee640e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Flow 'volume_create_manager' (8ff8c491-9f65-4803-b6a7-53cc63f50f6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:24:17 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-7b8e69b9-18f0-4b6a-a499-d0c13384e0d3 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Created volume successfully. Jun 29 11:24:18 devstack sudo[111303]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-37a920e4-2aa5-4adf-811e-e6497e4b2cfc 1073741824" returned: 0 in 0.840s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-37a920e4-2aa5-4adf-811e-e6497e4b2cfc {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:18 devstack sudo[111315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-37a920e4-2aa5-4adf-811e-e6497e4b2cfc Jun 29 11:24:18 devstack sudo[111315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:19 devstack sudo[111315]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-37a920e4-2aa5-4adf-811e-e6497e4b2cfc" returned: 0 in 0.653s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:19 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:24:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (287123a4-68ab-4a39-a6fc-d8e3dced6384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37a920e4-2aa5-4adf-811e-e6497e4b2cfc', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c071bf-f5f1-4e16-ba08-97fb2ddabf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:19 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Volume volume-37a920e4-2aa5-4adf-811e-e6497e4b2cfc (37a920e4-2aa5-4adf-811e-e6497e4b2cfc): created successfully Jun 29 11:24:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c071bf-f5f1-4e16-ba08-97fb2ddabf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:19 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Flow 'volume_create_manager' (b44dfe7f-d075-4dee-b1bc-5fd14eaec5f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:24:19 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-03596001-0a28-41f8-8b96-606a5c158397 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Created volume successfully. Jun 29 11:24:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-9d64a315-d965-4e06-91d4-c71c34104438 req-0d528f05-67d1-4312-a74a-28c259c97720 tempest-TestStampPattern-2118674922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-9d64a315-d965-4e06-91d4-c71c34104438 req-0d528f05-67d1-4312-a74a-28c259c97720 tempest-TestStampPattern-2118674922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:19 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2230a79c-72c6-4a24-b713-38b51d7d1a4b]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:24:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-9d64a315-d965-4e06-91d4-c71c34104438 req-0d528f05-67d1-4312-a74a-28c259c97720 tempest-TestStampPattern-2118674922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:19 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a532753d-0d27-4b56-8f1c-e23e8c311596 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "cinder-37a920e4-2aa5-4adf-811e-e6497e4b2cfc-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:24:19 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a532753d-0d27-4b56-8f1c-e23e8c311596 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "cinder-37a920e4-2aa5-4adf-811e-e6497e4b2cfc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:24:19 devstack sudo[111326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf Jun 29 11:24:19 devstack sudo[111326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:19 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a532753d-0d27-4b56-8f1c-e23e8c311596 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "cinder-quobyte-37a920e4-2aa5-4adf-811e-e6497e4b2cfc" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:24:19 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a532753d-0d27-4b56-8f1c-e23e8c311596 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "cinder-quobyte-37a920e4-2aa5-4adf-811e-e6497e4b2cfc" acquired by "delete_volume" :: waited 0.018s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:24:19 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60e6309-cfa7-4e00-8a13-8de25125fa4e]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:24:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a532753d-0d27-4b56-8f1c-e23e8c311596 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-37a920e4-2aa5-4adf-811e-e6497e4b2cfc {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:19 devstack sudo[111328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-37a920e4-2aa5-4adf-811e-e6497e4b2cfc Jun 29 11:24:19 devstack sudo[111328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:20 devstack sudo[111326]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-9d64a315-d965-4e06-91d4-c71c34104438 req-0d528f05-67d1-4312-a74a-28c259c97720 tempest-TestStampPattern-2118674922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf" returned: 0 in 0.757s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-9d64a315-d965-4e06-91d4-c71c34104438 req-0d528f05-67d1-4312-a74a-28c259c97720 tempest-TestStampPattern-2118674922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.781s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:20 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-9d64a315-d965-4e06-91d4-c71c34104438 req-0d528f05-67d1-4312-a74a-28c259c97720 tempest-TestStampPattern-2118674922 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3', 'name': 'volume-f5028f72-8569-4b03-aa99-e8087f7f0daf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8be99343-2068-4d87-a410-086ab2be0ce0', 'enforce_multipath': True} {{(pid=93497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 11:24:20 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-9d64a315-d965-4e06-91d4-c71c34104438 req-0d528f05-67d1-4312-a74a-28c259c97720 tempest-TestStampPattern-2118674922 None] attachment_update completed successfully. Jun 29 11:24:20 devstack sudo[111328]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a532753d-0d27-4b56-8f1c-e23e8c311596 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-37a920e4-2aa5-4adf-811e-e6497e4b2cfc" returned: 0 in 0.781s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a532753d-0d27-4b56-8f1c-e23e8c311596 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-37a920e4-2aa5-4adf-811e-e6497e4b2cfc {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:20 devstack sudo[111336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-37a920e4-2aa5-4adf-811e-e6497e4b2cfc Jun 29 11:24:20 devstack sudo[111336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:21 devstack sudo[111336]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a532753d-0d27-4b56-8f1c-e23e8c311596 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-37a920e4-2aa5-4adf-811e-e6497e4b2cfc" returned: 0 in 0.664s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:21 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a532753d-0d27-4b56-8f1c-e23e8c311596 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "cinder-quobyte-37a920e4-2aa5-4adf-811e-e6497e4b2cfc" released by "delete_volume" :: held 1.486s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:24:21 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-a532753d-0d27-4b56-8f1c-e23e8c311596 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Created reservations ['b81af459-1cce-4749-bb93-63ced2e96e9d', 'ddb44a45-3f92-4ae7-8993-e45d93d060e3', 'ecd51b3a-7f7e-4cef-878a-b4ea919a635f', '2ee64f4a-2b77-40e8-9b2b-a65e73706bfd'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:24:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a532753d-0d27-4b56-8f1c-e23e8c311596 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a532753d-0d27-4b56-8f1c-e23e8c311596 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:21 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a532753d-0d27-4b56-8f1c-e23e8c311596 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:24:21 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a532753d-0d27-4b56-8f1c-e23e8c311596 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:24:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a532753d-0d27-4b56-8f1c-e23e8c311596 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a532753d-0d27-4b56-8f1c-e23e8c311596 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:21 devstack sudo[111584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:24:21 devstack sudo[111584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:21 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e53c9d01-b9e1-44b5-946a-e829592f7d18 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "cinder-a0079d0f-3f6c-4688-b8f7-736505bf43b2-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:24:21 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e53c9d01-b9e1-44b5-946a-e829592f7d18 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "cinder-a0079d0f-3f6c-4688-b8f7-736505bf43b2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:24:21 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e53c9d01-b9e1-44b5-946a-e829592f7d18 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "cinder-quobyte-a0079d0f-3f6c-4688-b8f7-736505bf43b2" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:24:21 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e53c9d01-b9e1-44b5-946a-e829592f7d18 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "cinder-quobyte-a0079d0f-3f6c-4688-b8f7-736505bf43b2" acquired by "delete_volume" :: waited 0.019s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:24:21 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf41cb5-0c5f-494d-891d-943de8701da1]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:24:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e53c9d01-b9e1-44b5-946a-e829592f7d18 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a0079d0f-3f6c-4688-b8f7-736505bf43b2 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:21 devstack sudo[111584]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a532753d-0d27-4b56-8f1c-e23e8c311596 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.672s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:21 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-a532753d-0d27-4b56-8f1c-e23e8c311596 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:24:21 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-a532753d-0d27-4b56-8f1c-e23e8c311596 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Deleted volume successfully. Jun 29 11:24:21 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a532753d-0d27-4b56-8f1c-e23e8c311596 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "cinder-37a920e4-2aa5-4adf-811e-e6497e4b2cfc-delete_volume" released by "delete_volume" :: held 2.376s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:24:22 devstack sudo[111727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a0079d0f-3f6c-4688-b8f7-736505bf43b2 Jun 29 11:24:22 devstack sudo[111727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:22 devstack sudo[111727]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e53c9d01-b9e1-44b5-946a-e829592f7d18 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a0079d0f-3f6c-4688-b8f7-736505bf43b2" returned: 0 in 0.776s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e53c9d01-b9e1-44b5-946a-e829592f7d18 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a0079d0f-3f6c-4688-b8f7-736505bf43b2 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:22 devstack sudo[111732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a0079d0f-3f6c-4688-b8f7-736505bf43b2 Jun 29 11:24:22 devstack sudo[111732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:23 devstack sudo[111732]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e53c9d01-b9e1-44b5-946a-e829592f7d18 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a0079d0f-3f6c-4688-b8f7-736505bf43b2" returned: 0 in 0.625s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:23 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e53c9d01-b9e1-44b5-946a-e829592f7d18 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "cinder-quobyte-a0079d0f-3f6c-4688-b8f7-736505bf43b2" released by "delete_volume" :: held 1.447s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:24:23 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-e53c9d01-b9e1-44b5-946a-e829592f7d18 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Created reservations ['35aace0f-12a5-4de0-8eed-c1b7ab097b70', '62f30059-3d7d-4b21-a9bd-d8b363fc5f71', 'a15beaf7-cdf7-4c6f-a6b4-71864418fdbf', '074b737f-d0c6-4d16-adb9-b2f06feb2ad5'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:24:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e53c9d01-b9e1-44b5-946a-e829592f7d18 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e53c9d01-b9e1-44b5-946a-e829592f7d18 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:23 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-e53c9d01-b9e1-44b5-946a-e829592f7d18 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:24:23 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-e53c9d01-b9e1-44b5-946a-e829592f7d18 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:24:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e53c9d01-b9e1-44b5-946a-e829592f7d18 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e53c9d01-b9e1-44b5-946a-e829592f7d18 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:23 devstack sudo[111735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:24:23 devstack sudo[111735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:24 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8be17a72-e544-4353-8881-043fa4ec4754 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "cinder-5650354f-51cb-4b1c-a8ac-616f1958a19e-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:24:24 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8be17a72-e544-4353-8881-043fa4ec4754 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "cinder-5650354f-51cb-4b1c-a8ac-616f1958a19e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:24:24 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8be17a72-e544-4353-8881-043fa4ec4754 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "cinder-quobyte-5650354f-51cb-4b1c-a8ac-616f1958a19e" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:24:24 devstack sudo[111735]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:24 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8be17a72-e544-4353-8881-043fa4ec4754 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "cinder-quobyte-5650354f-51cb-4b1c-a8ac-616f1958a19e" acquired by "delete_volume" :: waited 0.019s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:24:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e53c9d01-b9e1-44b5-946a-e829592f7d18 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.697s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:24 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-e53c9d01-b9e1-44b5-946a-e829592f7d18 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:24:24 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-e53c9d01-b9e1-44b5-946a-e829592f7d18 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Deleted volume successfully. Jun 29 11:24:24 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a06d0fb-be73-4024-8256-31bc973c78c3]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:24:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8be17a72-e544-4353-8881-043fa4ec4754 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5650354f-51cb-4b1c-a8ac-616f1958a19e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:24 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e53c9d01-b9e1-44b5-946a-e829592f7d18 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "cinder-a0079d0f-3f6c-4688-b8f7-736505bf43b2-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:24:24 devstack sudo[111738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5650354f-51cb-4b1c-a8ac-616f1958a19e Jun 29 11:24:24 devstack sudo[111738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:24 devstack sudo[111738]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8be17a72-e544-4353-8881-043fa4ec4754 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5650354f-51cb-4b1c-a8ac-616f1958a19e" returned: 0 in 0.760s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8be17a72-e544-4353-8881-043fa4ec4754 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5650354f-51cb-4b1c-a8ac-616f1958a19e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:24 devstack sudo[111743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5650354f-51cb-4b1c-a8ac-616f1958a19e Jun 29 11:24:24 devstack sudo[111743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:25 devstack sudo[111743]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8be17a72-e544-4353-8881-043fa4ec4754 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5650354f-51cb-4b1c-a8ac-616f1958a19e" returned: 0 in 0.640s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:25 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8be17a72-e544-4353-8881-043fa4ec4754 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "cinder-quobyte-5650354f-51cb-4b1c-a8ac-616f1958a19e" released by "delete_volume" :: held 1.461s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:24:25 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-8be17a72-e544-4353-8881-043fa4ec4754 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Created reservations ['83ee50e8-4009-4932-ae15-72eaaef5ba8c', 'bedcbc35-451a-452b-8328-3786e2dcf440', '3a054c2e-1d43-4218-a727-70a1ffd9c796', 'a8948ce5-8acd-40e4-acc8-f729ff39cc11'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:24:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8be17a72-e544-4353-8881-043fa4ec4754 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8be17a72-e544-4353-8881-043fa4ec4754 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:25 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8be17a72-e544-4353-8881-043fa4ec4754 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:24:25 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8be17a72-e544-4353-8881-043fa4ec4754 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:24:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8be17a72-e544-4353-8881-043fa4ec4754 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8be17a72-e544-4353-8881-043fa4ec4754 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:25 devstack sudo[111757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:24:25 devstack sudo[111757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:26 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0b25b02d-6930-42ba-bc30-50cdee8b6d12 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "cinder-185e97d6-8414-4b25-b5c0-21faad963448-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:24:26 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0b25b02d-6930-42ba-bc30-50cdee8b6d12 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "cinder-185e97d6-8414-4b25-b5c0-21faad963448-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:24:26 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0b25b02d-6930-42ba-bc30-50cdee8b6d12 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "cinder-quobyte-185e97d6-8414-4b25-b5c0-21faad963448" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:24:26 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0b25b02d-6930-42ba-bc30-50cdee8b6d12 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "cinder-quobyte-185e97d6-8414-4b25-b5c0-21faad963448" acquired by "delete_volume" :: waited 0.017s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:24:26 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b84192-5f2c-445d-9ac1-be25e8a5c3c0]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:24:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0b25b02d-6930-42ba-bc30-50cdee8b6d12 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-185e97d6-8414-4b25-b5c0-21faad963448 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:26 devstack sudo[111757]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8be17a72-e544-4353-8881-043fa4ec4754 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.753s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:26 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-8be17a72-e544-4353-8881-043fa4ec4754 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:24:26 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-8be17a72-e544-4353-8881-043fa4ec4754 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Deleted volume successfully. Jun 29 11:24:26 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-8be17a72-e544-4353-8881-043fa4ec4754 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "cinder-5650354f-51cb-4b1c-a8ac-616f1958a19e-delete_volume" released by "delete_volume" :: held 2.442s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:24:26 devstack sudo[111760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-185e97d6-8414-4b25-b5c0-21faad963448 Jun 29 11:24:26 devstack sudo[111760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:27 devstack sudo[111760]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0b25b02d-6930-42ba-bc30-50cdee8b6d12 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-185e97d6-8414-4b25-b5c0-21faad963448" returned: 0 in 0.823s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0b25b02d-6930-42ba-bc30-50cdee8b6d12 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-185e97d6-8414-4b25-b5c0-21faad963448 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:27 devstack sudo[111765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-185e97d6-8414-4b25-b5c0-21faad963448 Jun 29 11:24:27 devstack sudo[111765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:28 devstack sudo[111765]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0b25b02d-6930-42ba-bc30-50cdee8b6d12 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-185e97d6-8414-4b25-b5c0-21faad963448" returned: 0 in 0.755s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:28 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0b25b02d-6930-42ba-bc30-50cdee8b6d12 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "cinder-quobyte-185e97d6-8414-4b25-b5c0-21faad963448" released by "delete_volume" :: held 1.622s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:24:28 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-0b25b02d-6930-42ba-bc30-50cdee8b6d12 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Created reservations ['40633fec-8f9a-48fb-90e6-4dc1a6c5a0a1', 'cac59549-5d6f-48bb-83de-a07fd0c8f8b9', '8887517a-a20b-4d85-a12c-9346b7e65a1a', '22cd0348-917c-4c22-87dc-c57421f8ed46'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:24:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0b25b02d-6930-42ba-bc30-50cdee8b6d12 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0b25b02d-6930-42ba-bc30-50cdee8b6d12 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:28 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0b25b02d-6930-42ba-bc30-50cdee8b6d12 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:24:28 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0b25b02d-6930-42ba-bc30-50cdee8b6d12 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:24:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0b25b02d-6930-42ba-bc30-50cdee8b6d12 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0b25b02d-6930-42ba-bc30-50cdee8b6d12 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:28 devstack sudo[111781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:24:28 devstack sudo[111781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:28 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-96d3eed6-ded1-492d-97b5-1cf962fdf5a9 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "cinder-46662428-0e80-4794-9936-77abac3a392d-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:24:28 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-96d3eed6-ded1-492d-97b5-1cf962fdf5a9 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "cinder-46662428-0e80-4794-9936-77abac3a392d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:24:28 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-96d3eed6-ded1-492d-97b5-1cf962fdf5a9 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "cinder-quobyte-46662428-0e80-4794-9936-77abac3a392d" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:24:28 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-96d3eed6-ded1-492d-97b5-1cf962fdf5a9 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "cinder-quobyte-46662428-0e80-4794-9936-77abac3a392d" acquired by "delete_volume" :: waited 0.019s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:24:28 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2f246b-0e32-4e46-9203-e646f8703229]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:24:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-96d3eed6-ded1-492d-97b5-1cf962fdf5a9 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-46662428-0e80-4794-9936-77abac3a392d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:28 devstack sudo[111783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-46662428-0e80-4794-9936-77abac3a392d Jun 29 11:24:28 devstack sudo[111783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:28 devstack sudo[111781]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0b25b02d-6930-42ba-bc30-50cdee8b6d12 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.680s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:28 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-0b25b02d-6930-42ba-bc30-50cdee8b6d12 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:24:28 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-0b25b02d-6930-42ba-bc30-50cdee8b6d12 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Deleted volume successfully. Jun 29 11:24:28 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0b25b02d-6930-42ba-bc30-50cdee8b6d12 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "cinder-185e97d6-8414-4b25-b5c0-21faad963448-delete_volume" released by "delete_volume" :: held 2.517s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:24:29 devstack sudo[111783]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-96d3eed6-ded1-492d-97b5-1cf962fdf5a9 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-46662428-0e80-4794-9936-77abac3a392d" returned: 0 in 0.795s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-96d3eed6-ded1-492d-97b5-1cf962fdf5a9 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-46662428-0e80-4794-9936-77abac3a392d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:29 devstack sudo[111790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-46662428-0e80-4794-9936-77abac3a392d Jun 29 11:24:29 devstack sudo[111790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:29 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-9873a95b-fb06-4aaa-be12-a70ffe657de2 req-be21d0dd-1217-40ca-b597-7aec3137e961 tempest-TestStampPattern-2118674922 None] Terminate volume connection completed successfully. Jun 29 11:24:29 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-9873a95b-fb06-4aaa-be12-a70ffe657de2 req-be21d0dd-1217-40ca-b597-7aec3137e961 tempest-TestStampPattern-2118674922 None] Deleting attachment 8be99343-2068-4d87-a410-086ab2be0ce0. {{(pid=93497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 11:24:30 devstack sudo[111790]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-96d3eed6-ded1-492d-97b5-1cf962fdf5a9 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-46662428-0e80-4794-9936-77abac3a392d" returned: 0 in 0.684s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:30 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-96d3eed6-ded1-492d-97b5-1cf962fdf5a9 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "cinder-quobyte-46662428-0e80-4794-9936-77abac3a392d" released by "delete_volume" :: held 1.521s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:24:30 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:UPDATE=104,cinder:SELECT=79,cinder:DELETE=12,cinder:INSERT=26 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:24:30 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-96d3eed6-ded1-492d-97b5-1cf962fdf5a9 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Created reservations ['b8934675-ee13-4b2f-9392-cd0178e7372e', 'c99754ca-4b17-4345-a0d3-e2b355d7ca8d', 'd01c95e8-5dbd-4b8a-bc5e-be6aeb5a0442', '95212068-646e-4892-86b1-18506b03fc1b'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:24:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-96d3eed6-ded1-492d-97b5-1cf962fdf5a9 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-96d3eed6-ded1-492d-97b5-1cf962fdf5a9 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:30 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-96d3eed6-ded1-492d-97b5-1cf962fdf5a9 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:24:30 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-96d3eed6-ded1-492d-97b5-1cf962fdf5a9 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:24:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-96d3eed6-ded1-492d-97b5-1cf962fdf5a9 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-96d3eed6-ded1-492d-97b5-1cf962fdf5a9 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:30 devstack sudo[111823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:24:30 devstack sudo[111823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:30 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4062a692-7a10-42a3-9fcf-8e2afcb2a2d4 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "cinder-2b9f27b7-79c5-4643-99d9-85c9f608c6f8-delete_snapshot" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:24:30 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4062a692-7a10-42a3-9fcf-8e2afcb2a2d4 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "cinder-2b9f27b7-79c5-4643-99d9-85c9f608c6f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:24:30 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4062a692-7a10-42a3-9fcf-8e2afcb2a2d4 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "cinder-quobyte-17dd78c1-9274-4067-aa6f-b2ffd8a673c4" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:24:30 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4062a692-7a10-42a3-9fcf-8e2afcb2a2d4 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "cinder-quobyte-17dd78c1-9274-4067-aa6f-b2ffd8a673c4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:24:30 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4062a692-7a10-42a3-9fcf-8e2afcb2a2d4 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "cinder-quobyte-2b9f27b7-79c5-4643-99d9-85c9f608c6f8" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:24:30 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4062a692-7a10-42a3-9fcf-8e2afcb2a2d4 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "cinder-quobyte-2b9f27b7-79c5-4643-99d9-85c9f608c6f8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:24:30 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-4062a692-7a10-42a3-9fcf-8e2afcb2a2d4 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Deleting offline snapshot 2b9f27b7-79c5-4643-99d9-85c9f608c6f8 of volume 17dd78c1-9274-4067-aa6f-b2ffd8a673c4 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:24:30 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-4062a692-7a10-42a3-9fcf-8e2afcb2a2d4 tempest-CreateVolumesFromSnapshotTest-1297558146 None] snapshot_file for this snap is: volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4.2b9f27b7-79c5-4643-99d9-85c9f608c6f8 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:24:30 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[50451dbe-9517-40f7-b20f-02b712bdb30c]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:24:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4062a692-7a10-42a3-9fcf-8e2afcb2a2d4 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4.2b9f27b7-79c5-4643-99d9-85c9f608c6f8 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:31 devstack sudo[111823]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-96d3eed6-ded1-492d-97b5-1cf962fdf5a9 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.715s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:31 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-96d3eed6-ded1-492d-97b5-1cf962fdf5a9 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:24:31 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-96d3eed6-ded1-492d-97b5-1cf962fdf5a9 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Deleted volume successfully. Jun 29 11:24:31 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-96d3eed6-ded1-492d-97b5-1cf962fdf5a9 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "cinder-46662428-0e80-4794-9936-77abac3a392d-delete_volume" released by "delete_volume" :: held 2.440s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:24:31 devstack sudo[111826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4.2b9f27b7-79c5-4643-99d9-85c9f608c6f8 Jun 29 11:24:31 devstack sudo[111826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:31 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=88,cinder:UPDATE=130,cinder:INSERT=27,cinder:DELETE=10 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:24:31 devstack sudo[111826]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4062a692-7a10-42a3-9fcf-8e2afcb2a2d4 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4.2b9f27b7-79c5-4643-99d9-85c9f608c6f8" returned: 0 in 0.802s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:31 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-4062a692-7a10-42a3-9fcf-8e2afcb2a2d4 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:24:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-354f317d-a5c8-4b12-9baa-e4ce83c8fe61 tempest-TestStampPattern-2118674922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-354f317d-a5c8-4b12-9baa-e4ce83c8fe61 tempest-TestStampPattern-2118674922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:31 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[329f451e-fd1c-40e0-999b-a9bd4ba24dfc]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:24:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4062a692-7a10-42a3-9fcf-8e2afcb2a2d4 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:31 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-354f317d-a5c8-4b12-9baa-e4ce83c8fe61 tempest-TestStampPattern-2118674922 None] Creating offline snapshot 5c7a3c0c-2cda-46be-ae67-ca95679aa129 of volume f5028f72-8569-4b03-aa99-e8087f7f0daf {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:24:31 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fb15b5-6f68-4854-9d80-2b5a47b93518]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:24:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-354f317d-a5c8-4b12-9baa-e4ce83c8fe61 tempest-TestStampPattern-2118674922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:31 devstack sudo[111832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4 Jun 29 11:24:31 devstack sudo[111832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:31 devstack sudo[111833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf Jun 29 11:24:31 devstack sudo[111833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:32 devstack sudo[111832]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4062a692-7a10-42a3-9fcf-8e2afcb2a2d4 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4" returned: 0 in 0.794s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4062a692-7a10-42a3-9fcf-8e2afcb2a2d4 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4.2b9f27b7-79c5-4643-99d9-85c9f608c6f8 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:32 devstack sudo[111842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4.2b9f27b7-79c5-4643-99d9-85c9f608c6f8 Jun 29 11:24:32 devstack sudo[111842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:32 devstack sudo[111833]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-354f317d-a5c8-4b12-9baa-e4ce83c8fe61 tempest-TestStampPattern-2118674922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf" returned: 0 in 0.785s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-354f317d-a5c8-4b12-9baa-e4ce83c8fe61 tempest-TestStampPattern-2118674922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf.5c7a3c0c-2cda-46be-ae67-ca95679aa129 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:32 devstack sudo[111844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf.5c7a3c0c-2cda-46be-ae67-ca95679aa129 1G Jun 29 11:24:32 devstack sudo[111844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:33 devstack sudo[111842]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4062a692-7a10-42a3-9fcf-8e2afcb2a2d4 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4.2b9f27b7-79c5-4643-99d9-85c9f608c6f8" returned: 0 in 0.763s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4062a692-7a10-42a3-9fcf-8e2afcb2a2d4 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4.2b9f27b7-79c5-4643-99d9-85c9f608c6f8 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:33 devstack sudo[111853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4.2b9f27b7-79c5-4643-99d9-85c9f608c6f8 Jun 29 11:24:33 devstack sudo[111853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:33 devstack sudo[111844]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-354f317d-a5c8-4b12-9baa-e4ce83c8fe61 tempest-TestStampPattern-2118674922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf.5c7a3c0c-2cda-46be-ae67-ca95679aa129 1G" returned: 0 in 0.808s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-354f317d-a5c8-4b12-9baa-e4ce83c8fe61 tempest-TestStampPattern-2118674922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5028f72-8569-4b03-aa99-e8087f7f0daf -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf.5c7a3c0c-2cda-46be-ae67-ca95679aa129 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:33 devstack sudo[111855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5028f72-8569-4b03-aa99-e8087f7f0daf -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf.5c7a3c0c-2cda-46be-ae67-ca95679aa129 Jun 29 11:24:33 devstack sudo[111855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:33 devstack sudo[111853]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4062a692-7a10-42a3-9fcf-8e2afcb2a2d4 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4.2b9f27b7-79c5-4643-99d9-85c9f608c6f8" returned: 0 in 0.672s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:34 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4062a692-7a10-42a3-9fcf-8e2afcb2a2d4 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "cinder-quobyte-2b9f27b7-79c5-4643-99d9-85c9f608c6f8" released by "_delete_snapshot" :: held 3.145s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:24:34 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4062a692-7a10-42a3-9fcf-8e2afcb2a2d4 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "cinder-quobyte-17dd78c1-9274-4067-aa6f-b2ffd8a673c4" released by "delete_snapshot" :: held 3.170s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:24:34 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-4062a692-7a10-42a3-9fcf-8e2afcb2a2d4 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Created reservations ['cc1e0740-b32a-4052-b947-39e048b15465', '18e5498b-8ad9-40ad-bdce-46d6c4110504', 'cf0e1cbb-b866-4425-966c-dc0244d5e0f4', 'a605bede-de55-462c-a69c-de65dcf54cdb'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:24:34 devstack sudo[111855]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-354f317d-a5c8-4b12-9baa-e4ce83c8fe61 tempest-TestStampPattern-2118674922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5028f72-8569-4b03-aa99-e8087f7f0daf -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf.5c7a3c0c-2cda-46be-ae67-ca95679aa129" returned: 0 in 0.713s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:34 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-354f317d-a5c8-4b12-9baa-e4ce83c8fe61 tempest-TestStampPattern-2118674922 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf.5c7a3c0c-2cda-46be-ae67-ca95679aa129 is being set with open permissions: ugo+rw Jun 29 11:24:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-354f317d-a5c8-4b12-9baa-e4ce83c8fe61 tempest-TestStampPattern-2118674922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf.5c7a3c0c-2cda-46be-ae67-ca95679aa129 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:34 devstack sudo[111861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf.5c7a3c0c-2cda-46be-ae67-ca95679aa129 Jun 29 11:24:34 devstack sudo[111861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:34 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-4062a692-7a10-42a3-9fcf-8e2afcb2a2d4 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Delete snapshot completed successfully. Jun 29 11:24:34 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4062a692-7a10-42a3-9fcf-8e2afcb2a2d4 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "cinder-2b9f27b7-79c5-4643-99d9-85c9f608c6f8-delete_snapshot" released by "delete_snapshot" :: held 3.322s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:24:34 devstack sudo[111861]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-354f317d-a5c8-4b12-9baa-e4ce83c8fe61 tempest-TestStampPattern-2118674922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf.5c7a3c0c-2cda-46be-ae67-ca95679aa129" returned: 0 in 0.625s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-354f317d-a5c8-4b12-9baa-e4ce83c8fe61 tempest-TestStampPattern-2118674922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:34 devstack sudo[111864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf.info Jun 29 11:24:34 devstack sudo[111864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:35 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-76f828c2-d42f-4cf9-8cbc-a7684b46bda6 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "cinder-17dd78c1-9274-4067-aa6f-b2ffd8a673c4-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:24:35 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-76f828c2-d42f-4cf9-8cbc-a7684b46bda6 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "cinder-17dd78c1-9274-4067-aa6f-b2ffd8a673c4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:24:35 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-76f828c2-d42f-4cf9-8cbc-a7684b46bda6 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "cinder-quobyte-17dd78c1-9274-4067-aa6f-b2ffd8a673c4" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:24:35 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-76f828c2-d42f-4cf9-8cbc-a7684b46bda6 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "cinder-quobyte-17dd78c1-9274-4067-aa6f-b2ffd8a673c4" acquired by "delete_volume" :: waited 0.024s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:24:35 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7a546a-80dd-4e4f-9b0b-14bdee343770]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:24:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-76f828c2-d42f-4cf9-8cbc-a7684b46bda6 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:35 devstack sudo[111866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4 Jun 29 11:24:35 devstack sudo[111866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:35 devstack sudo[111864]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-354f317d-a5c8-4b12-9baa-e4ce83c8fe61 tempest-TestStampPattern-2118674922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf.info" returned: 0 in 0.656s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:35 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-354f317d-a5c8-4b12-9baa-e4ce83c8fe61 tempest-TestStampPattern-2118674922 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf.info is being set with open permissions: ugo+rw Jun 29 11:24:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-354f317d-a5c8-4b12-9baa-e4ce83c8fe61 tempest-TestStampPattern-2118674922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:35 devstack sudo[111869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf.info Jun 29 11:24:35 devstack sudo[111869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:35 devstack sudo[111866]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-76f828c2-d42f-4cf9-8cbc-a7684b46bda6 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4" returned: 0 in 0.754s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-76f828c2-d42f-4cf9-8cbc-a7684b46bda6 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:35 devstack sudo[111874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4 Jun 29 11:24:35 devstack sudo[111874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:36 devstack sudo[111869]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-354f317d-a5c8-4b12-9baa-e4ce83c8fe61 tempest-TestStampPattern-2118674922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf.info" returned: 0 in 0.663s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-354f317d-a5c8-4b12-9baa-e4ce83c8fe61 tempest-TestStampPattern-2118674922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.351s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:36 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-354f317d-a5c8-4b12-9baa-e4ce83c8fe61 tempest-TestStampPattern-2118674922 None] Create snapshot completed successfully Jun 29 11:24:36 devstack sudo[111874]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-76f828c2-d42f-4cf9-8cbc-a7684b46bda6 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17dd78c1-9274-4067-aa6f-b2ffd8a673c4" returned: 0 in 0.638s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-76f828c2-d42f-4cf9-8cbc-a7684b46bda6 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "cinder-quobyte-17dd78c1-9274-4067-aa6f-b2ffd8a673c4" released by "delete_volume" :: held 1.454s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:24:36 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-76f828c2-d42f-4cf9-8cbc-a7684b46bda6 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Created reservations ['1d2844a1-adf7-46c6-a9d8-43021bf5ecf7', '6f33437a-3c06-4088-bd46-e6878a68d60f', '195c8ee2-a6b1-4b87-b197-1d03eaedf624', 'f28763fd-6e8a-4951-9b29-fc49c1c9d7a5'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:24:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-76f828c2-d42f-4cf9-8cbc-a7684b46bda6 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-76f828c2-d42f-4cf9-8cbc-a7684b46bda6 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:36 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-76f828c2-d42f-4cf9-8cbc-a7684b46bda6 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:24:36 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-76f828c2-d42f-4cf9-8cbc-a7684b46bda6 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:24:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-76f828c2-d42f-4cf9-8cbc-a7684b46bda6 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-76f828c2-d42f-4cf9-8cbc-a7684b46bda6 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:36 devstack sudo[111878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:24:36 devstack sudo[111878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:37 devstack sudo[111878]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-76f828c2-d42f-4cf9-8cbc-a7684b46bda6 tempest-CreateVolumesFromSnapshotTest-1297558146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.676s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:37 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-76f828c2-d42f-4cf9-8cbc-a7684b46bda6 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:24:37 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-76f828c2-d42f-4cf9-8cbc-a7684b46bda6 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Deleted volume successfully. Jun 29 11:24:37 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-76f828c2-d42f-4cf9-8cbc-a7684b46bda6 tempest-CreateVolumesFromSnapshotTest-1297558146 None] Lock "cinder-17dd78c1-9274-4067-aa6f-b2ffd8a673c4-delete_volume" released by "delete_volume" :: held 2.360s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:24:40 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:24:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Flow 'volume_create_manager' (52a64046-a94e-49c2-82b0-b98e7fb30912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:24:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20ca3402-7d4f-482e-9b74-b456ba0db61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20ca3402-7d4f-482e-9b74-b456ba0db61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-856481605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3da8106-fa29-49cb-98a0-5949a894f827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8b24d638094454a4b752e029a95f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:24:40Z,use_quota=True,user_id='4a350da0f6924f3cb07c7a99aba72d56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db667883-6b27-47ce-978c-146b0e689ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db667883-6b27-47ce-978c-146b0e689ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (091a440d-ed1c-482f-812c-57630dec008b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (091a440d-ed1c-482f-812c-57630dec008b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3da8106-fa29-49cb-98a0-5949a894f827', 'volume_name': 'volume-c3da8106-fa29-49cb-98a0-5949a894f827', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdaa4fc4-e72b-4efe-b417-1036134a0d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdaa4fc4-e72b-4efe-b417-1036134a0d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7458976-10a8-4e2e-9e9c-5b36b9568c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:40 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Volume c3da8106-fa29-49cb-98a0-5949a894f827: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3da8106-fa29-49cb-98a0-5949a894f827', 'volume_size': 1} Jun 29 11:24:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:40 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-856481605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3da8106-fa29-49cb-98a0-5949a894f827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8b24d638094454a4b752e029a95f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:24:40Z,use_quota=True,user_id='4a350da0f6924f3cb07c7a99aba72d56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:24:40 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Creating volume c3da8106-fa29-49cb-98a0-5949a894f827 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:24:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:40 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:24:40 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:24:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:40 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:24:40 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:24:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3da8106-fa29-49cb-98a0-5949a894f827 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:40 devstack sudo[111882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3da8106-fa29-49cb-98a0-5949a894f827 1073741824 Jun 29 11:24:40 devstack sudo[111882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:40 devstack sudo[111882]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3da8106-fa29-49cb-98a0-5949a894f827 1073741824" returned: 0 in 0.796s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3da8106-fa29-49cb-98a0-5949a894f827 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:41 devstack sudo[111887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3da8106-fa29-49cb-98a0-5949a894f827 Jun 29 11:24:41 devstack sudo[111887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:41 devstack sudo[111887]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3da8106-fa29-49cb-98a0-5949a894f827" returned: 0 in 0.639s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:41 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:24:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7458976-10a8-4e2e-9e9c-5b36b9568c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3da8106-fa29-49cb-98a0-5949a894f827', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633c65f4-1319-486f-b9e4-33a7728d09ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:41 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Volume volume-c3da8106-fa29-49cb-98a0-5949a894f827 (c3da8106-fa29-49cb-98a0-5949a894f827): created successfully Jun 29 11:24:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633c65f4-1319-486f-b9e4-33a7728d09ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Flow 'volume_create_manager' (52a64046-a94e-49c2-82b0-b98e7fb30912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:24:41 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-65826943-2858-4b41-a304-86bf16035403 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Created volume successfully. Jun 29 11:24:42 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:24:42 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Flow 'volume_create_manager' (4963e269-a4d3-4b95-925b-bbc8eab25d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:24:42 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f826b3-feec-4621-a3d1-65b7c682d4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:42 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f826b3-feec-4621-a3d1-65b7c682d4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-945772079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=261962cd-4bce-46fc-a6ef-05d7f5a5f77b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8b24d638094454a4b752e029a95f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:24:43Z,use_quota=True,user_id='4a350da0f6924f3cb07c7a99aba72d56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:42 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33103b5a-abef-45c1-bf8c-8b06104e8a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:42 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33103b5a-abef-45c1-bf8c-8b06104e8a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:42 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d946f01-35be-4b3b-89e4-8e7a662e44f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:42 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d946f01-35be-4b3b-89e4-8e7a662e44f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '261962cd-4bce-46fc-a6ef-05d7f5a5f77b', 'volume_name': 'volume-261962cd-4bce-46fc-a6ef-05d7f5a5f77b', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:42 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d5fa0c9-9668-4941-ac31-cee79213b935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:42 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d5fa0c9-9668-4941-ac31-cee79213b935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:42 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1bc2d7-d211-4c6b-9179-99fc54e69b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:42 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Volume 261962cd-4bce-46fc-a6ef-05d7f5a5f77b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-261962cd-4bce-46fc-a6ef-05d7f5a5f77b', 'volume_size': 1} Jun 29 11:24:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:42 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-945772079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=261962cd-4bce-46fc-a6ef-05d7f5a5f77b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8b24d638094454a4b752e029a95f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:24:43Z,use_quota=True,user_id='4a350da0f6924f3cb07c7a99aba72d56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:24:42 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Creating volume 261962cd-4bce-46fc-a6ef-05d7f5a5f77b {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:24:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:42 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:24:42 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:24:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:42 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:24:42 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:24:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-261962cd-4bce-46fc-a6ef-05d7f5a5f77b 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:42 devstack sudo[111928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-261962cd-4bce-46fc-a6ef-05d7f5a5f77b 1073741824 Jun 29 11:24:42 devstack sudo[111928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:42 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:24:42 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Flow 'volume_create_manager' (c565d8fd-e78b-44b5-9b97-298b386eefe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:24:42 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ea600e-34e7-44ac-a00b-e0099ce5a129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ea600e-34e7-44ac-a00b-e0099ce5a129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1874612402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb5c37c6-81fd-454a-9ec3-4bdc76383ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8b24d638094454a4b752e029a95f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:24:43Z,use_quota=True,user_id='4a350da0f6924f3cb07c7a99aba72d56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbec4e6-35ea-41a9-882f-a6de65f1f046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbec4e6-35ea-41a9-882f-a6de65f1f046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccecff29-c0e4-4271-8455-8cfbdfe0b06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccecff29-c0e4-4271-8455-8cfbdfe0b06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb5c37c6-81fd-454a-9ec3-4bdc76383ff7', 'volume_name': 'volume-bb5c37c6-81fd-454a-9ec3-4bdc76383ff7', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a551d98d-d2ca-4c06-9252-a2764cc82ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a551d98d-d2ca-4c06-9252-a2764cc82ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (390f3c01-033d-4a9f-937a-4ae120e2f709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:43 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Volume bb5c37c6-81fd-454a-9ec3-4bdc76383ff7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb5c37c6-81fd-454a-9ec3-4bdc76383ff7', 'volume_size': 1} Jun 29 11:24:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:43 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:24:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Flow 'volume_create_manager' (e07c571d-2142-4fef-9e99-0dd3f5704a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:24:43 devstack sudo[111928]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (590b648d-9691-411b-adbb-10b8a0a96f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-261962cd-4bce-46fc-a6ef-05d7f5a5f77b 1073741824" returned: 0 in 0.915s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (590b648d-9691-411b-adbb-10b8a0a96f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-276802350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1258a1c-cd86-43aa-b719-817a1139dd93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8b24d638094454a4b752e029a95f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:24:43Z,use_quota=True,user_id='4a350da0f6924f3cb07c7a99aba72d56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d25b2c-1db4-40fe-9d0a-68e19ffb2ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d25b2c-1db4-40fe-9d0a-68e19ffb2ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22a4a058-5288-4379-8d74-5c20025ec349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22a4a058-5288-4379-8d74-5c20025ec349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1258a1c-cd86-43aa-b719-817a1139dd93', 'volume_name': 'volume-c1258a1c-cd86-43aa-b719-817a1139dd93', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca62a89b-6c5a-45fb-a07b-6af046cefc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca62a89b-6c5a-45fb-a07b-6af046cefc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5233023-fad2-4ea6-a1fc-4c1b14d2d074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:43 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Volume c1258a1c-cd86-43aa-b719-817a1139dd93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1258a1c-cd86-43aa-b719-817a1139dd93', 'volume_size': 1} Jun 29 11:24:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-261962cd-4bce-46fc-a6ef-05d7f5a5f77b {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:43 devstack sudo[111934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-261962cd-4bce-46fc-a6ef-05d7f5a5f77b Jun 29 11:24:43 devstack sudo[111934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Flow 'volume_create_manager' (646f718f-89be-4108-ba72-22d616da0fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6065ae-4ce5-4d8f-913b-2fab93e5bd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6065ae-4ce5-4d8f-913b-2fab93e5bd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-962508868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=211a1391-0daf-45ce-aa5b-cb18600d7b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8b24d638094454a4b752e029a95f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:24:44Z,use_quota=True,user_id='4a350da0f6924f3cb07c7a99aba72d56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e671107-5846-4925-abc8-17b2caba70e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e671107-5846-4925-abc8-17b2caba70e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (061ac4db-6628-41d2-a3b5-db4ba9ef9098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (061ac4db-6628-41d2-a3b5-db4ba9ef9098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '211a1391-0daf-45ce-aa5b-cb18600d7b4e', 'volume_name': 'volume-211a1391-0daf-45ce-aa5b-cb18600d7b4e', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75838121-4b8d-42e9-af5a-3489bb19be3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75838121-4b8d-42e9-af5a-3489bb19be3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ed5d0f2-8143-4d80-a3e1-c2a8833aa20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:44 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Volume 211a1391-0daf-45ce-aa5b-cb18600d7b4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-211a1391-0daf-45ce-aa5b-cb18600d7b4e', 'volume_size': 1} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Flow 'volume_create_manager' (397d0a79-4b55-49de-9dd5-5ed5ef8e49c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b4dd478-098d-479e-8ff0-e14df2b0050e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b4dd478-098d-479e-8ff0-e14df2b0050e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-640415126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d4bfa61-17d9-47a0-9b65-5acbefbae93e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8b24d638094454a4b752e029a95f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:24:44Z,use_quota=True,user_id='4a350da0f6924f3cb07c7a99aba72d56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e750415-0e89-4f15-bd72-ed89640d1176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e750415-0e89-4f15-bd72-ed89640d1176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff566f14-9b4c-49a7-a238-c1f9162fe8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff566f14-9b4c-49a7-a238-c1f9162fe8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d4bfa61-17d9-47a0-9b65-5acbefbae93e', 'volume_name': 'volume-5d4bfa61-17d9-47a0-9b65-5acbefbae93e', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb9046d2-1360-4e1a-aa50-51a547dde778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb9046d2-1360-4e1a-aa50-51a547dde778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09fa52d5-2509-46e0-836d-f348eaa2941a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:44 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Volume 5d4bfa61-17d9-47a0-9b65-5acbefbae93e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d4bfa61-17d9-47a0-9b65-5acbefbae93e', 'volume_size': 1} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:44 devstack sudo[111934]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-261962cd-4bce-46fc-a6ef-05d7f5a5f77b" returned: 0 in 0.796s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] <== create_volume: return (1835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.493s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1874612402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb5c37c6-81fd-454a-9ec3-4bdc76383ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8b24d638094454a4b752e029a95f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:24:43Z,use_quota=True,user_id='4a350da0f6924f3cb07c7a99aba72d56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Creating volume bb5c37c6-81fd-454a-9ec3-4bdc76383ff7 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:24:44 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-bb5c37c6-81fd-454a-9ec3-4bdc76383ff7 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1bc2d7-d211-4c6b-9179-99fc54e69b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-261962cd-4bce-46fc-a6ef-05d7f5a5f77b', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:44 devstack sudo[111937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-bb5c37c6-81fd-454a-9ec3-4bdc76383ff7 1073741824 Jun 29 11:24:44 devstack sudo[111937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8299329-e2c8-49bd-a1f2-35223e42168a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:44 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Volume volume-261962cd-4bce-46fc-a6ef-05d7f5a5f77b (261962cd-4bce-46fc-a6ef-05d7f5a5f77b): created successfully Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8299329-e2c8-49bd-a1f2-35223e42168a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Flow 'volume_create_manager' (4963e269-a4d3-4b95-925b-bbc8eab25d25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:24:44 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-d441ccd4-3cac-43bb-911c-d9adb4628071 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Created volume successfully. Jun 29 11:24:45 devstack sudo[111937]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-bb5c37c6-81fd-454a-9ec3-4bdc76383ff7 1073741824" returned: 0 in 0.876s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-bb5c37c6-81fd-454a-9ec3-4bdc76383ff7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:45 devstack sudo[111946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-bb5c37c6-81fd-454a-9ec3-4bdc76383ff7 Jun 29 11:24:45 devstack sudo[111946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:46 devstack sudo[111946]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-bb5c37c6-81fd-454a-9ec3-4bdc76383ff7" returned: 0 in 0.651s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:24:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.421s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-276802350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1258a1c-cd86-43aa-b719-817a1139dd93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8b24d638094454a4b752e029a95f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:24:43Z,use_quota=True,user_id='4a350da0f6924f3cb07c7a99aba72d56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:24:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Creating volume c1258a1c-cd86-43aa-b719-817a1139dd93 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:24:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:24:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:24:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:46 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:24:46 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:24:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c1258a1c-cd86-43aa-b719-817a1139dd93 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:46 devstack sudo[111949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c1258a1c-cd86-43aa-b719-817a1139dd93 1073741824 Jun 29 11:24:46 devstack sudo[111949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (390f3c01-033d-4a9f-937a-4ae120e2f709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb5c37c6-81fd-454a-9ec3-4bdc76383ff7', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8442c14b-9dda-4633-8b7b-965390c33a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:46 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Volume volume-bb5c37c6-81fd-454a-9ec3-4bdc76383ff7 (bb5c37c6-81fd-454a-9ec3-4bdc76383ff7): created successfully Jun 29 11:24:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8442c14b-9dda-4633-8b7b-965390c33a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Flow 'volume_create_manager' (c565d8fd-e78b-44b5-9b97-298b386eefe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:24:46 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-71b6534f-ee00-4ba3-9254-74a28f4ab7ce tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Created volume successfully. Jun 29 11:24:46 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:24:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Flow 'volume_create_manager' (040f151b-2111-4993-a143-2fc58828b9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:24:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c098ad9-9e8e-4719-80fe-53c47282f39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c098ad9-9e8e-4719-80fe-53c47282f39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-548481856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f008307-b074-4da9-9a08-a2e4351bb958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb8382e0833433b99304a20f1d7e080',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5c7a3c0c-2cda-46be-ae67-ca95679aa129,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:24:47Z,use_quota=True,user_id='6184260b075e446d9ea799fbd9911e5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba5185a-a9be-4935-81cb-60654852def1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba5185a-a9be-4935-81cb-60654852def1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e7b28a-0179-402e-b4da-4aa9b66bed3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e7b28a-0179-402e-b4da-4aa9b66bed3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5f008307-b074-4da9-9a08-a2e4351bb958', 'volume_name': 'volume-5f008307-b074-4da9-9a08-a2e4351bb958', 'volume_size': 1, 'snapshot_id': '5c7a3c0c-2cda-46be-ae67-ca95679aa129'}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7545374e-c783-4af3-9445-03fb32b1acc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7545374e-c783-4af3-9445-03fb32b1acc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f341a33-d114-43cb-bcf5-efbfeedbc7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:47 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Volume 5f008307-b074-4da9-9a08-a2e4351bb958: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5f008307-b074-4da9-9a08-a2e4351bb958', 'volume_size': 1, 'snapshot_id': '5c7a3c0c-2cda-46be-ae67-ca95679aa129'} Jun 29 11:24:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:47 devstack sudo[111949]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c1258a1c-cd86-43aa-b719-817a1139dd93 1073741824" returned: 0 in 0.922s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c1258a1c-cd86-43aa-b719-817a1139dd93 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:47 devstack sudo[111955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c1258a1c-cd86-43aa-b719-817a1139dd93 Jun 29 11:24:47 devstack sudo[111955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:47 devstack sudo[111955]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c1258a1c-cd86-43aa-b719-817a1139dd93" returned: 0 in 0.670s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:24:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.613s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-962508868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=211a1391-0daf-45ce-aa5b-cb18600d7b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8b24d638094454a4b752e029a95f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:24:44Z,use_quota=True,user_id='4a350da0f6924f3cb07c7a99aba72d56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:24:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Creating volume 211a1391-0daf-45ce-aa5b-cb18600d7b4e {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:24:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:24:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:24:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:24:47 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:24:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-211a1391-0daf-45ce-aa5b-cb18600d7b4e 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:47 devstack sudo[111959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-211a1391-0daf-45ce-aa5b-cb18600d7b4e 1073741824 Jun 29 11:24:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5233023-fad2-4ea6-a1fc-4c1b14d2d074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1258a1c-cd86-43aa-b719-817a1139dd93', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:47 devstack sudo[111959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2d35c7-d72d-4f1b-8ec5-6bc544cc4aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:47 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Volume volume-c1258a1c-cd86-43aa-b719-817a1139dd93 (c1258a1c-cd86-43aa-b719-817a1139dd93): created successfully Jun 29 11:24:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2d35c7-d72d-4f1b-8ec5-6bc544cc4aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Flow 'volume_create_manager' (e07c571d-2142-4fef-9e99-0dd3f5704a8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:24:47 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-b7e2f1aa-ec07-4d85-a761-fc391d3385f6 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Created volume successfully. Jun 29 11:24:48 devstack sudo[111959]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-211a1391-0daf-45ce-aa5b-cb18600d7b4e 1073741824" returned: 0 in 0.850s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-211a1391-0daf-45ce-aa5b-cb18600d7b4e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:48 devstack sudo[111966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-211a1391-0daf-45ce-aa5b-cb18600d7b4e Jun 29 11:24:48 devstack sudo[111966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:49 devstack sudo[111966]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-211a1391-0daf-45ce-aa5b-cb18600d7b4e" returned: 0 in 0.657s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:49 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:24:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.854s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:49 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-640415126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d4bfa61-17d9-47a0-9b65-5acbefbae93e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8b24d638094454a4b752e029a95f15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:24:44Z,use_quota=True,user_id='4a350da0f6924f3cb07c7a99aba72d56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:24:49 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Creating volume 5d4bfa61-17d9-47a0-9b65-5acbefbae93e {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:24:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:49 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:24:49 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:24:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:49 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:24:49 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:24:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5d4bfa61-17d9-47a0-9b65-5acbefbae93e 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:49 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ed5d0f2-8143-4d80-a3e1-c2a8833aa20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-211a1391-0daf-45ce-aa5b-cb18600d7b4e', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:49 devstack sudo[111969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5d4bfa61-17d9-47a0-9b65-5acbefbae93e 1073741824 Jun 29 11:24:49 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31210701-8197-4d06-b81f-2317f0609d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:49 devstack sudo[111969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:49 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Volume volume-211a1391-0daf-45ce-aa5b-cb18600d7b4e (211a1391-0daf-45ce-aa5b-cb18600d7b4e): created successfully Jun 29 11:24:49 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31210701-8197-4d06-b81f-2317f0609d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:49 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Flow 'volume_create_manager' (646f718f-89be-4108-ba72-22d616da0fc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:24:49 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-d9e9c0ef-95cf-4825-980e-fb3d5a47a788 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Created volume successfully. Jun 29 11:24:50 devstack sudo[111969]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5d4bfa61-17d9-47a0-9b65-5acbefbae93e 1073741824" returned: 0 in 0.835s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5d4bfa61-17d9-47a0-9b65-5acbefbae93e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:50 devstack sudo[111975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5d4bfa61-17d9-47a0-9b65-5acbefbae93e Jun 29 11:24:50 devstack sudo[111975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:50 devstack sudo[111975]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5d4bfa61-17d9-47a0-9b65-5acbefbae93e" returned: 0 in 0.657s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:24:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.828s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:50 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Acquiring lock "cinder-quobyte-5c7a3c0c-2cda-46be-ae67-ca95679aa129-5f008307-b074-4da9-9a08-a2e4351bb958" by "_create_volume_from_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:24:50 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Lock "cinder-quobyte-5c7a3c0c-2cda-46be-ae67-ca95679aa129-5f008307-b074-4da9-9a08-a2e4351bb958" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:24:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Creating volume 5f008307-b074-4da9-9a08-a2e4351bb958 from snapshot 5c7a3c0c-2cda-46be-ae67-ca95679aa129 {{(pid=93497) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 29 11:24:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:24:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:24:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:24:50 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Acquiring lock "cinder-quobyte-5f008307-b074-4da9-9a08-a2e4351bb958" by "_copy_volume_from_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:24:50 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Lock "cinder-quobyte-5f008307-b074-4da9-9a08-a2e4351bb958" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:24:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] snapshot: 5c7a3c0c-2cda-46be-ae67-ca95679aa129, volume: 5f008307-b074-4da9-9a08-a2e4351bb958, {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 11:24:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:24:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:24:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09fa52d5-2509-46e0-836d-f348eaa2941a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d4bfa61-17d9-47a0-9b65-5acbefbae93e', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b9cbe03-44c7-4fa0-b2db-fc5893360ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:24:50 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0976c122-f627-47e1-a9ec-3ee30bfa0e03]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:24:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf.5c7a3c0c-2cda-46be-ae67-ca95679aa129 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:50 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Volume volume-5d4bfa61-17d9-47a0-9b65-5acbefbae93e (5d4bfa61-17d9-47a0-9b65-5acbefbae93e): created successfully Jun 29 11:24:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b9cbe03-44c7-4fa0-b2db-fc5893360ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:24:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Flow 'volume_create_manager' (397d0a79-4b55-49de-9dd5-5ed5ef8e49c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:24:51 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-104c9b5d-0d17-4e1a-bf3c-6cda3e483751 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Created volume successfully. Jun 29 11:24:51 devstack sudo[111978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf.5c7a3c0c-2cda-46be-ae67-ca95679aa129 Jun 29 11:24:51 devstack sudo[111978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:51 devstack sudo[111978]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf.5c7a3c0c-2cda-46be-ae67-ca95679aa129" returned: 0 in 0.747s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5028f72-8569-4b03-aa99-e8087f7f0daf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:24:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 11:24:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Creating direct copy from snapshot {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 11:24:51 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8db91e5-a8fa-4acd-9ffd-ae7f46e0200f]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:24:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:51 devstack sudo[111983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf Jun 29 11:24:51 devstack sudo[111983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:52 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-5cab8be3-4c8d-48c0-9dd7-a7ca6ca17431 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Acquiring lock "cinder-5d4bfa61-17d9-47a0-9b65-5acbefbae93e-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:24:52 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-5cab8be3-4c8d-48c0-9dd7-a7ca6ca17431 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "cinder-5d4bfa61-17d9-47a0-9b65-5acbefbae93e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:24:52 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-5cab8be3-4c8d-48c0-9dd7-a7ca6ca17431 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Acquiring lock "cinder-quobyte-5d4bfa61-17d9-47a0-9b65-5acbefbae93e" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:24:52 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-5cab8be3-4c8d-48c0-9dd7-a7ca6ca17431 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "cinder-quobyte-5d4bfa61-17d9-47a0-9b65-5acbefbae93e" acquired by "delete_volume" :: waited 0.021s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:24:52 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c18420-d02c-4629-bc9a-211e804dbe90]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:24:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5cab8be3-4c8d-48c0-9dd7-a7ca6ca17431 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5d4bfa61-17d9-47a0-9b65-5acbefbae93e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:52 devstack sudo[111985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5d4bfa61-17d9-47a0-9b65-5acbefbae93e Jun 29 11:24:52 devstack sudo[111985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:52 devstack sudo[111983]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf" returned: 0 in 0.838s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:52 devstack cinder-volume[93497]: DEBUG cinder.utils [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Path /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5f008307-b074-4da9-9a08-a2e4351bb958 not found in is_blk_device check {{(pid=93497) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 11:24:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5f008307-b074-4da9-9a08-a2e4351bb958 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:52 devstack sudo[111990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5f008307-b074-4da9-9a08-a2e4351bb958 Jun 29 11:24:52 devstack sudo[111990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:53 devstack sudo[111985]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5cab8be3-4c8d-48c0-9dd7-a7ca6ca17431 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5d4bfa61-17d9-47a0-9b65-5acbefbae93e" returned: 0 in 0.839s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5cab8be3-4c8d-48c0-9dd7-a7ca6ca17431 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5d4bfa61-17d9-47a0-9b65-5acbefbae93e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:53 devstack sudo[111995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5d4bfa61-17d9-47a0-9b65-5acbefbae93e Jun 29 11:24:53 devstack sudo[111995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:54 devstack sudo[111995]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5cab8be3-4c8d-48c0-9dd7-a7ca6ca17431 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5d4bfa61-17d9-47a0-9b65-5acbefbae93e" returned: 0 in 1.255s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:54 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-5cab8be3-4c8d-48c0-9dd7-a7ca6ca17431 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "cinder-quobyte-5d4bfa61-17d9-47a0-9b65-5acbefbae93e" released by "delete_volume" :: held 2.186s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:24:54 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-5cab8be3-4c8d-48c0-9dd7-a7ca6ca17431 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Created reservations ['447a7595-ace7-452b-a397-9125062ca45a', '89a97940-224a-438a-b90a-23fce74efda9', 'cc0155c6-b1c8-4f99-96f3-61437f68044c', '5f4e3b1e-1921-45fb-80b1-93fe9b4612b2'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:24:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5cab8be3-4c8d-48c0-9dd7-a7ca6ca17431 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5cab8be3-4c8d-48c0-9dd7-a7ca6ca17431 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5cab8be3-4c8d-48c0-9dd7-a7ca6ca17431 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:24:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5cab8be3-4c8d-48c0-9dd7-a7ca6ca17431 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:24:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5cab8be3-4c8d-48c0-9dd7-a7ca6ca17431 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5cab8be3-4c8d-48c0-9dd7-a7ca6ca17431 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:54 devstack sudo[112008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:24:54 devstack sudo[112008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ca197b86-86fa-4b8c-9acc-5c6e930a7ceb tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Acquiring lock "cinder-211a1391-0daf-45ce-aa5b-cb18600d7b4e-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:24:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ca197b86-86fa-4b8c-9acc-5c6e930a7ceb tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "cinder-211a1391-0daf-45ce-aa5b-cb18600d7b4e-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:24:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ca197b86-86fa-4b8c-9acc-5c6e930a7ceb tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Acquiring lock "cinder-quobyte-211a1391-0daf-45ce-aa5b-cb18600d7b4e" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:24:56 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ca197b86-86fa-4b8c-9acc-5c6e930a7ceb tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "cinder-quobyte-211a1391-0daf-45ce-aa5b-cb18600d7b4e" acquired by "delete_volume" :: waited 0.031s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:24:56 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37f48e0-103f-4bec-a29e-4e388bd08085]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:24:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ca197b86-86fa-4b8c-9acc-5c6e930a7ceb tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-211a1391-0daf-45ce-aa5b-cb18600d7b4e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:56 devstack sudo[112046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-211a1391-0daf-45ce-aa5b-cb18600d7b4e Jun 29 11:24:56 devstack sudo[112046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:56 devstack sudo[112008]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5cab8be3-4c8d-48c0-9dd7-a7ca6ca17431 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.890s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:56 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-5cab8be3-4c8d-48c0-9dd7-a7ca6ca17431 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:24:56 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-5cab8be3-4c8d-48c0-9dd7-a7ca6ca17431 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Deleted volume successfully. Jun 29 11:24:56 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-5cab8be3-4c8d-48c0-9dd7-a7ca6ca17431 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "cinder-5d4bfa61-17d9-47a0-9b65-5acbefbae93e-delete_volume" released by "delete_volume" :: held 4.714s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:24:58 devstack sudo[112046]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ca197b86-86fa-4b8c-9acc-5c6e930a7ceb tempest-CreateVolumesFromSourceVolumeTest-385244312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-211a1391-0daf-45ce-aa5b-cb18600d7b4e" returned: 0 in 2.394s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ca197b86-86fa-4b8c-9acc-5c6e930a7ceb tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-211a1391-0daf-45ce-aa5b-cb18600d7b4e {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:58 devstack sudo[112068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-211a1391-0daf-45ce-aa5b-cb18600d7b4e Jun 29 11:24:58 devstack sudo[112068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:59 devstack sudo[111990]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5f008307-b074-4da9-9a08-a2e4351bb958" returned: 0 in 7.113s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:59 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a32246-b1a7-4fc6-bbda-9b75c7aa2263]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:24:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:59 devstack sudo[112068]: pam_unix(sudo:session): session closed for user root Jun 29 11:24:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ca197b86-86fa-4b8c-9acc-5c6e930a7ceb tempest-CreateVolumesFromSourceVolumeTest-385244312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-211a1391-0daf-45ce-aa5b-cb18600d7b4e" returned: 0 in 1.229s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:24:59 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ca197b86-86fa-4b8c-9acc-5c6e930a7ceb tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "cinder-quobyte-211a1391-0daf-45ce-aa5b-cb18600d7b4e" released by "delete_volume" :: held 3.734s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:24:59 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-ca197b86-86fa-4b8c-9acc-5c6e930a7ceb tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Created reservations ['a23e7198-3f24-429c-8314-bb10e44450d5', '05daab21-6d8a-43e6-838b-dc4b8b2e078e', 'bba0b288-a8ca-41e5-b8b1-190a95ae9288', '65fd6a98-e746-422f-8998-91f000fbea84'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:24:59 devstack sudo[112083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf Jun 29 11:24:59 devstack sudo[112083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:24:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ca197b86-86fa-4b8c-9acc-5c6e930a7ceb tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:24:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ca197b86-86fa-4b8c-9acc-5c6e930a7ceb tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:24:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ca197b86-86fa-4b8c-9acc-5c6e930a7ceb tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:24:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ca197b86-86fa-4b8c-9acc-5c6e930a7ceb tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:24:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ca197b86-86fa-4b8c-9acc-5c6e930a7ceb tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:24:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ca197b86-86fa-4b8c-9acc-5c6e930a7ceb tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:24:59 devstack sudo[112088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:24:59 devstack sudo[112088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:00 devstack sudo[112088]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ca197b86-86fa-4b8c-9acc-5c6e930a7ceb tempest-CreateVolumesFromSourceVolumeTest-385244312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.680s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:00 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-ca197b86-86fa-4b8c-9acc-5c6e930a7ceb tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:25:00 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-ca197b86-86fa-4b8c-9acc-5c6e930a7ceb tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Deleted volume successfully. Jun 29 11:25:00 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ca197b86-86fa-4b8c-9acc-5c6e930a7ceb tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "cinder-211a1391-0daf-45ce-aa5b-cb18600d7b4e-delete_volume" released by "delete_volume" :: held 4.702s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:25:00 devstack sudo[112083]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf" returned: 0 in 1.025s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:00 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Image conversion details: src /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf, size 1024.00 MB, duration 7.11 sec, destination /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5f008307-b074-4da9-9a08-a2e4351bb958 {{(pid=93497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 11:25:00 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Converted 1024.00 MB image at 143.93 MB/s Jun 29 11:25:00 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5f008307-b074-4da9-9a08-a2e4351bb958 is being set with open permissions: ugo+rw Jun 29 11:25:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5f008307-b074-4da9-9a08-a2e4351bb958 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:00 devstack sudo[112097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5f008307-b074-4da9-9a08-a2e4351bb958 Jun 29 11:25:00 devstack sudo[112097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:00 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a2d3b433-16fe-4b96-b324-82521a8e6745 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Acquiring lock "cinder-c1258a1c-cd86-43aa-b719-817a1139dd93-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:25:00 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a2d3b433-16fe-4b96-b324-82521a8e6745 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "cinder-c1258a1c-cd86-43aa-b719-817a1139dd93-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:25:00 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a2d3b433-16fe-4b96-b324-82521a8e6745 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Acquiring lock "cinder-quobyte-c1258a1c-cd86-43aa-b719-817a1139dd93" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:25:00 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a2d3b433-16fe-4b96-b324-82521a8e6745 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "cinder-quobyte-c1258a1c-cd86-43aa-b719-817a1139dd93" acquired by "delete_volume" :: waited 0.017s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:25:00 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[851af305-017c-4536-819e-f39dd2916e5f]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:25:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a2d3b433-16fe-4b96-b324-82521a8e6745 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c1258a1c-cd86-43aa-b719-817a1139dd93 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:01 devstack sudo[112099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c1258a1c-cd86-43aa-b719-817a1139dd93 Jun 29 11:25:01 devstack sudo[112099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:01 devstack sudo[112097]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5f008307-b074-4da9-9a08-a2e4351bb958" returned: 0 in 0.671s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Lock "cinder-quobyte-5f008307-b074-4da9-9a08-a2e4351bb958" released by "_copy_volume_from_snapshot" :: held 10.495s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:25:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Lock "cinder-quobyte-5c7a3c0c-2cda-46be-ae67-ca95679aa129-5f008307-b074-4da9-9a08-a2e4351bb958" released by "_create_volume_from_snapshot" :: held 10.529s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:25:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.554s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:25:01 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f341a33-d114-43cb-bcf5-efbfeedbc7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f008307-b074-4da9-9a08-a2e4351bb958', 'volume_size': 1, 'snapshot_id': '5c7a3c0c-2cda-46be-ae67-ca95679aa129'}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:25:01 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31187843-f462-45c9-b1a5-090a0e8a4aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:25:01 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Volume volume-5f008307-b074-4da9-9a08-a2e4351bb958 (5f008307-b074-4da9-9a08-a2e4351bb958): created successfully Jun 29 11:25:01 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31187843-f462-45c9-b1a5-090a0e8a4aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:25:01 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Flow 'volume_create_manager' (040f151b-2111-4993-a143-2fc58828b9c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:25:01 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-b0507f76-9c71-4938-9596-fe7bcd2e5452 tempest-TestStampPattern-2118674922 None] Created volume successfully. Jun 29 11:25:01 devstack sudo[112099]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a2d3b433-16fe-4b96-b324-82521a8e6745 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c1258a1c-cd86-43aa-b719-817a1139dd93" returned: 0 in 0.780s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a2d3b433-16fe-4b96-b324-82521a8e6745 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c1258a1c-cd86-43aa-b719-817a1139dd93 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:01 devstack sudo[112108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c1258a1c-cd86-43aa-b719-817a1139dd93 Jun 29 11:25:01 devstack sudo[112108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:02 devstack sudo[112108]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a2d3b433-16fe-4b96-b324-82521a8e6745 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c1258a1c-cd86-43aa-b719-817a1139dd93" returned: 0 in 0.653s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:02 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a2d3b433-16fe-4b96-b324-82521a8e6745 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "cinder-quobyte-c1258a1c-cd86-43aa-b719-817a1139dd93" released by "delete_volume" :: held 1.480s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:25:02 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-a2d3b433-16fe-4b96-b324-82521a8e6745 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Created reservations ['a992cdec-28a0-4793-b6d8-ec9be1612bb0', 'ce202055-3db0-4b8e-b013-ae2f20b5f587', 'de0024ca-070a-4d6d-a67f-5624105210b3', 'a641b54a-19c1-4030-a633-c98e277f2326'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:25:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a2d3b433-16fe-4b96-b324-82521a8e6745 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:25:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a2d3b433-16fe-4b96-b324-82521a8e6745 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:25:02 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a2d3b433-16fe-4b96-b324-82521a8e6745 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:25:02 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a2d3b433-16fe-4b96-b324-82521a8e6745 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:25:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a2d3b433-16fe-4b96-b324-82521a8e6745 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:25:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a2d3b433-16fe-4b96-b324-82521a8e6745 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:02 devstack sudo[112121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:25:02 devstack sudo[112121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0dd08e2b-0fb2-4b8e-809a-18e92e304b2d tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Acquiring lock "cinder-bb5c37c6-81fd-454a-9ec3-4bdc76383ff7-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:25:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0dd08e2b-0fb2-4b8e-809a-18e92e304b2d tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "cinder-bb5c37c6-81fd-454a-9ec3-4bdc76383ff7-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:25:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0dd08e2b-0fb2-4b8e-809a-18e92e304b2d tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Acquiring lock "cinder-quobyte-bb5c37c6-81fd-454a-9ec3-4bdc76383ff7" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:25:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0dd08e2b-0fb2-4b8e-809a-18e92e304b2d tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "cinder-quobyte-bb5c37c6-81fd-454a-9ec3-4bdc76383ff7" acquired by "delete_volume" :: waited 0.039s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:25:03 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6250ade3-c1c9-4b48-967f-2b84a700cf49]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:25:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0dd08e2b-0fb2-4b8e-809a-18e92e304b2d tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-bb5c37c6-81fd-454a-9ec3-4bdc76383ff7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:03 devstack sudo[112121]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a2d3b433-16fe-4b96-b324-82521a8e6745 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.019s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:03 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-a2d3b433-16fe-4b96-b324-82521a8e6745 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:25:03 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-a2d3b433-16fe-4b96-b324-82521a8e6745 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Deleted volume successfully. Jun 29 11:25:03 devstack sudo[112347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-bb5c37c6-81fd-454a-9ec3-4bdc76383ff7 Jun 29 11:25:03 devstack sudo[112347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a2d3b433-16fe-4b96-b324-82521a8e6745 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "cinder-c1258a1c-cd86-43aa-b719-817a1139dd93-delete_volume" released by "delete_volume" :: held 2.739s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:25:04 devstack sudo[112347]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0dd08e2b-0fb2-4b8e-809a-18e92e304b2d tempest-CreateVolumesFromSourceVolumeTest-385244312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-bb5c37c6-81fd-454a-9ec3-4bdc76383ff7" returned: 0 in 0.971s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0dd08e2b-0fb2-4b8e-809a-18e92e304b2d tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-bb5c37c6-81fd-454a-9ec3-4bdc76383ff7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:04 devstack sudo[112505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-bb5c37c6-81fd-454a-9ec3-4bdc76383ff7 Jun 29 11:25:04 devstack sudo[112505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:05 devstack sudo[112505]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0dd08e2b-0fb2-4b8e-809a-18e92e304b2d tempest-CreateVolumesFromSourceVolumeTest-385244312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-bb5c37c6-81fd-454a-9ec3-4bdc76383ff7" returned: 0 in 0.740s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:05 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0dd08e2b-0fb2-4b8e-809a-18e92e304b2d tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "cinder-quobyte-bb5c37c6-81fd-454a-9ec3-4bdc76383ff7" released by "delete_volume" :: held 1.784s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:25:05 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-0dd08e2b-0fb2-4b8e-809a-18e92e304b2d tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Created reservations ['bdf6e860-224e-46dc-bfc6-efaafa8bfd87', '409ffa91-7581-4a24-b0a0-2d61391c6d72', '12606624-b53f-4139-b15e-be205380e38c', '3f040501-da6d-4cc7-9015-e07ce8561c7d'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:25:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0dd08e2b-0fb2-4b8e-809a-18e92e304b2d tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:25:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0dd08e2b-0fb2-4b8e-809a-18e92e304b2d tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:25:05 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0dd08e2b-0fb2-4b8e-809a-18e92e304b2d tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:25:05 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0dd08e2b-0fb2-4b8e-809a-18e92e304b2d tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:25:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0dd08e2b-0fb2-4b8e-809a-18e92e304b2d tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:25:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0dd08e2b-0fb2-4b8e-809a-18e92e304b2d tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:05 devstack sudo[112508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:25:05 devstack sudo[112508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:05 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fb6fb29f-961a-4bb3-aa4f-8e544196d163 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Acquiring lock "cinder-261962cd-4bce-46fc-a6ef-05d7f5a5f77b-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:25:05 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fb6fb29f-961a-4bb3-aa4f-8e544196d163 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "cinder-261962cd-4bce-46fc-a6ef-05d7f5a5f77b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:25:05 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fb6fb29f-961a-4bb3-aa4f-8e544196d163 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Acquiring lock "cinder-quobyte-261962cd-4bce-46fc-a6ef-05d7f5a5f77b" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:25:05 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fb6fb29f-961a-4bb3-aa4f-8e544196d163 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "cinder-quobyte-261962cd-4bce-46fc-a6ef-05d7f5a5f77b" acquired by "delete_volume" :: waited 0.041s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:25:05 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e6363a-809d-48c8-9c5f-f008d3df430a]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:25:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fb6fb29f-961a-4bb3-aa4f-8e544196d163 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-261962cd-4bce-46fc-a6ef-05d7f5a5f77b {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:05 devstack sudo[112510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-261962cd-4bce-46fc-a6ef-05d7f5a5f77b Jun 29 11:25:05 devstack sudo[112510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:06 devstack sudo[112508]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0dd08e2b-0fb2-4b8e-809a-18e92e304b2d tempest-CreateVolumesFromSourceVolumeTest-385244312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.776s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:06 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-0dd08e2b-0fb2-4b8e-809a-18e92e304b2d tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:25:06 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-0dd08e2b-0fb2-4b8e-809a-18e92e304b2d tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Deleted volume successfully. Jun 29 11:25:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-0dd08e2b-0fb2-4b8e-809a-18e92e304b2d tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "cinder-bb5c37c6-81fd-454a-9ec3-4bdc76383ff7-delete_volume" released by "delete_volume" :: held 2.897s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:25:06 devstack sudo[112510]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fb6fb29f-961a-4bb3-aa4f-8e544196d163 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-261962cd-4bce-46fc-a6ef-05d7f5a5f77b" returned: 0 in 0.998s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fb6fb29f-961a-4bb3-aa4f-8e544196d163 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-261962cd-4bce-46fc-a6ef-05d7f5a5f77b {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:06 devstack sudo[112516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-261962cd-4bce-46fc-a6ef-05d7f5a5f77b Jun 29 11:25:06 devstack sudo[112516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:07 devstack sudo[112516]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fb6fb29f-961a-4bb3-aa4f-8e544196d163 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-261962cd-4bce-46fc-a6ef-05d7f5a5f77b" returned: 0 in 0.706s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:07 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fb6fb29f-961a-4bb3-aa4f-8e544196d163 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "cinder-quobyte-261962cd-4bce-46fc-a6ef-05d7f5a5f77b" released by "delete_volume" :: held 1.777s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:25:07 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-fb6fb29f-961a-4bb3-aa4f-8e544196d163 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Created reservations ['01e17788-adc4-4569-933b-fa474f80e45f', 'c1851552-444a-4b36-8684-02ae2a138513', '16f2a994-42c6-4b35-a3e2-7a21b7e7ad27', 'f19824a9-4e6e-4584-bcb0-c07477e99d30'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:25:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fb6fb29f-961a-4bb3-aa4f-8e544196d163 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:25:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fb6fb29f-961a-4bb3-aa4f-8e544196d163 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:25:07 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-fb6fb29f-961a-4bb3-aa4f-8e544196d163 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:25:07 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-fb6fb29f-961a-4bb3-aa4f-8e544196d163 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:25:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fb6fb29f-961a-4bb3-aa4f-8e544196d163 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:25:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fb6fb29f-961a-4bb3-aa4f-8e544196d163 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:07 devstack sudo[112519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:25:07 devstack sudo[112519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:07 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ea2cdb84-8005-45bb-9f12-1d8f7cc5f804 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Acquiring lock "cinder-c3da8106-fa29-49cb-98a0-5949a894f827-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:25:07 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ea2cdb84-8005-45bb-9f12-1d8f7cc5f804 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "cinder-c3da8106-fa29-49cb-98a0-5949a894f827-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:25:07 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ea2cdb84-8005-45bb-9f12-1d8f7cc5f804 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Acquiring lock "cinder-quobyte-c3da8106-fa29-49cb-98a0-5949a894f827" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:25:07 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ea2cdb84-8005-45bb-9f12-1d8f7cc5f804 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "cinder-quobyte-c3da8106-fa29-49cb-98a0-5949a894f827" acquired by "delete_volume" :: waited 0.017s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:25:07 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db8c89b-be09-4fc3-87f6-49a630c6e6fe]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:25:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ea2cdb84-8005-45bb-9f12-1d8f7cc5f804 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3da8106-fa29-49cb-98a0-5949a894f827 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:08 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:25:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:25:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:25:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:25:08 devstack sudo[112522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3da8106-fa29-49cb-98a0-5949a894f827 Jun 29 11:25:08 devstack sudo[112522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:25:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:25:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:08 devstack sudo[112525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:25:08 devstack sudo[112525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:08 devstack sudo[112519]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fb6fb29f-961a-4bb3-aa4f-8e544196d163 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.986s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:08 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-fb6fb29f-961a-4bb3-aa4f-8e544196d163 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:25:08 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-fb6fb29f-961a-4bb3-aa4f-8e544196d163 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Deleted volume successfully. Jun 29 11:25:08 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fb6fb29f-961a-4bb3-aa4f-8e544196d163 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "cinder-261962cd-4bce-46fc-a6ef-05d7f5a5f77b-delete_volume" released by "delete_volume" :: held 3.106s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:25:08 devstack sudo[112522]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ea2cdb84-8005-45bb-9f12-1d8f7cc5f804 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3da8106-fa29-49cb-98a0-5949a894f827" returned: 0 in 0.990s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ea2cdb84-8005-45bb-9f12-1d8f7cc5f804 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3da8106-fa29-49cb-98a0-5949a894f827 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:08 devstack sudo[112525]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.854s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:08 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:25:08 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager._thread_info {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:25:08 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread count: 29 {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 11:25:08 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread info: [<_MainThread(MainThread, started 131117520400512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 11:25:08 devstack sudo[112533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3da8106-fa29-49cb-98a0-5949a894f827 Jun 29 11:25:08 devstack sudo[112533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:09 devstack sudo[112533]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ea2cdb84-8005-45bb-9f12-1d8f7cc5f804 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3da8106-fa29-49cb-98a0-5949a894f827" returned: 0 in 0.667s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ea2cdb84-8005-45bb-9f12-1d8f7cc5f804 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "cinder-quobyte-c3da8106-fa29-49cb-98a0-5949a894f827" released by "delete_volume" :: held 1.718s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:25:09 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-ea2cdb84-8005-45bb-9f12-1d8f7cc5f804 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Created reservations ['12242f87-3ba6-451e-83aa-d39fa85be464', '72bb7361-8957-4570-a427-d52575c776e4', '9ef99ddc-0e20-406b-a205-3ac3e31314ca', 'b0a0b5f2-b100-4fca-a2a8-a6138edef1f6'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:25:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ea2cdb84-8005-45bb-9f12-1d8f7cc5f804 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:25:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ea2cdb84-8005-45bb-9f12-1d8f7cc5f804 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:25:09 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ea2cdb84-8005-45bb-9f12-1d8f7cc5f804 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:25:09 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ea2cdb84-8005-45bb-9f12-1d8f7cc5f804 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:25:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ea2cdb84-8005-45bb-9f12-1d8f7cc5f804 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:25:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ea2cdb84-8005-45bb-9f12-1d8f7cc5f804 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:09 devstack sudo[112536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:25:09 devstack sudo[112536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:10 devstack sudo[112536]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ea2cdb84-8005-45bb-9f12-1d8f7cc5f804 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.655s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:10 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-ea2cdb84-8005-45bb-9f12-1d8f7cc5f804 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:25:10 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-ea2cdb84-8005-45bb-9f12-1d8f7cc5f804 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Deleted volume successfully. Jun 29 11:25:10 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ea2cdb84-8005-45bb-9f12-1d8f7cc5f804 tempest-CreateVolumesFromSourceVolumeTest-385244312 None] Lock "cinder-c3da8106-fa29-49cb-98a0-5949a894f827-delete_volume" released by "delete_volume" :: held 2.598s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:25:15 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:25:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Flow 'volume_create_manager' (44c924c8-5ca6-4fe3-afc4-c9a705767964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:25:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9acb54d2-fcb5-4da0-b5e1-fe3aa13f3e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:25:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9acb54d2-fcb5-4da0-b5e1-fe3aa13f3e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8ed9cce-5352-4fd4-a1bc-a19ee839bf31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63befb14fc494362af438e95b0e8e422',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:25:16Z,use_quota=True,user_id='d3d13a887d554c059e38b8b709747c0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:25:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d78db7e-8ba3-4444-8897-7719474aa4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:25:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d78db7e-8ba3-4444-8897-7719474aa4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:25:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4077ef68-db16-4a20-b09e-7e0ff4ce81cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:25:15 devstack cinder-volume[93497]: DEBUG cinder.image.glance [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Creating Keystone auth plugin from conf {{(pid=93497) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 29 11:25:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4077ef68-db16-4a20-b09e-7e0ff4ce81cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f8ed9cce-5352-4fd4-a1bc-a19ee839bf31', 'volume_name': 'volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31', 'volume_size': 1, 'image_id': 'edb7c9c5-c53e-4c1d-af14-ed51bcb3817a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edb7c9c5-c53e-4c1d-af14-ed51bcb3817a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'aa0e12f9e46ecf9d594e30e0d79e4946', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '63befb14fc494362af438e95b0e8e422', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3746115fce6fc8a11963099f9c61d0d7ffeb4cd3936a4920aef158bb96f530c4f8ff4e1d0b1fb6a41e5f178a7be571cf824622dcc8d8342ff9bef46c6f4dff74', 'id': 'edb7c9c5-c53e-4c1d-af14-ed51bcb3817a', 'created_at': datetime.datetime(2026, 6, 29, 9, 25, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 9, 25, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edb7c9c5-c53e-4c1d-af14-ed51bcb3817a/file', 'properties': {}}, 'image_service': }' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:25:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e943520-9c55-48bc-9ffe-6ff8779461c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:25:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e943520-9c55-48bc-9ffe-6ff8779461c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:25:15 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (570764f8-0f4f-4e0b-8ea0-ad6685e5f871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:25:15 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Volume f8ed9cce-5352-4fd4-a1bc-a19ee839bf31: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31', 'volume_size': 1, 'image_id': 'edb7c9c5-c53e-4c1d-af14-ed51bcb3817a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edb7c9c5-c53e-4c1d-af14-ed51bcb3817a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'aa0e12f9e46ecf9d594e30e0d79e4946', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '63befb14fc494362af438e95b0e8e422', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3746115fce6fc8a11963099f9c61d0d7ffeb4cd3936a4920aef158bb96f530c4f8ff4e1d0b1fb6a41e5f178a7be571cf824622dcc8d8342ff9bef46c6f4dff74', 'id': 'edb7c9c5-c53e-4c1d-af14-ed51bcb3817a', 'created_at': datetime.datetime(2026, 6, 29, 9, 25, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 9, 25, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edb7c9c5-c53e-4c1d-af14-ed51bcb3817a/file', 'properties': {}}, 'image_service': } Jun 29 11:25:15 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Trying to clone f8ed9cce-5352-4fd4-a1bc-a19ee839bf31 from image edb7c9c5-c53e-4c1d-af14-ed51bcb3817a at location (None, [{'url': 'file:///opt/stack/data/glance/images/edb7c9c5-c53e-4c1d-af14-ed51bcb3817a', 'metadata': {}}]). {{(pid=93497) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 29 11:25:16 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_qeswxab2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93497) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 29 11:25:16 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Image download 0.00 MB at 0.00 MB/s Jun 29 11:25:16 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[34432f37-71c9-4d4b-ae04-390287c70dba]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:25:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_qeswxab2devstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:16 devstack sudo[112640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_qeswxab2devstack@QuobyteHD Jun 29 11:25:16 devstack sudo[112640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:16 devstack sudo[112640]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_qeswxab2devstack@QuobyteHD" returned: 0 in 0.754s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_qeswxab2devstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:17 devstack sudo[112651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_qeswxab2devstack@QuobyteHD Jun 29 11:25:17 devstack sudo[112651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:17 devstack sudo[112651]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_qeswxab2devstack@QuobyteHD" returned: 1 in 0.704s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_qeswxab2devstack@QuobyteHD' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:25:17 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Temporary image edb7c9c5-c53e-4c1d-af14-ed51bcb3817a is fetched for user d3d13a887d554c059e38b8b709747c0a. {{(pid=93497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 29 11:25:17 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf5f429-750f-47ec-b368-c8dbd732d6ce]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:25:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_qeswxab2devstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:17 devstack sudo[112657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_qeswxab2devstack@QuobyteHD Jun 29 11:25:17 devstack sudo[112657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:18 devstack sudo[112657]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_qeswxab2devstack@QuobyteHD" returned: 0 in 0.728s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_qeswxab2devstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:18 devstack sudo[112661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_qeswxab2devstack@QuobyteHD Jun 29 11:25:18 devstack sudo[112661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:19 devstack sudo[112661]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_qeswxab2devstack@QuobyteHD" returned: 1 in 0.720s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_qeswxab2devstack@QuobyteHD' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:25:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:25:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:25:19 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8ed9cce-5352-4fd4-a1bc-a19ee839bf31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63befb14fc494362af438e95b0e8e422',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:25:16Z,use_quota=True,user_id='d3d13a887d554c059e38b8b709747c0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:25:19 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Creating volume f8ed9cce-5352-4fd4-a1bc-a19ee839bf31 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:25:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:25:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:25:19 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:25:19 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:25:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:25:19 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:25:19 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:25:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:19 devstack sudo[112672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31 1073741824 Jun 29 11:25:19 devstack sudo[112672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:19 devstack sudo[112672]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31 1073741824" returned: 0 in 0.815s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:20 devstack sudo[112678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31 Jun 29 11:25:20 devstack sudo[112678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:20 devstack sudo[112678]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31" returned: 0 in 0.634s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:20 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:25:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:25:20 devstack cinder-volume[93497]: DEBUG cinder.volume.volume_utils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Attempting download of edb7c9c5-c53e-4c1d-af14-ed51bcb3817a ((None, [{'url': 'file:///opt/stack/data/glance/images/edb7c9c5-c53e-4c1d-af14-ed51bcb3817a', 'metadata': {}}])) to volume f8ed9cce-5352-4fd4-a1bc-a19ee839bf31. {{(pid=93497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 29 11:25:20 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b01cb7f-841a-4142-a4d4-15bc16803504]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:25:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_idgyqkso {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:20 devstack sudo[112681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_idgyqkso Jun 29 11:25:20 devstack sudo[112681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:21 devstack sudo[112681]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_idgyqkso" returned: 0 in 0.707s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:21 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_idgyqkso {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:21 devstack sudo[112685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_idgyqkso Jun 29 11:25:21 devstack sudo[112685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:22 devstack sudo[112685]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_idgyqkso" returned: 1 in 0.738s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_idgyqkso' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:25:22 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[49160794-44f4-4cac-a793-0d2f369e34b0]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:25:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_qeswxab2devstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:22 devstack sudo[112689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_qeswxab2devstack@QuobyteHD Jun 29 11:25:22 devstack sudo[112689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:22 devstack sudo[112689]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_qeswxab2devstack@QuobyteHD" returned: 0 in 0.712s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:22 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_qeswxab2devstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:22 devstack sudo[112693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_qeswxab2devstack@QuobyteHD Jun 29 11:25:22 devstack sudo[112693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:23 devstack sudo[112693]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_qeswxab2devstack@QuobyteHD" returned: 1 in 0.720s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_qeswxab2devstack@QuobyteHD' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:25:23 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] edb7c9c5-c53e-4c1d-af14-ed51bcb3817a was raw, converting to raw {{(pid=93497) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 29 11:25:23 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_qeswxab2devstack@QuobyteHD /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:23 devstack sudo[112698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_qeswxab2devstack@QuobyteHD /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31 Jun 29 11:25:23 devstack sudo[112698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:24 devstack sudo[112698]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_qeswxab2devstack@QuobyteHD /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31" returned: 0 in 0.712s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:24 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_edb7c9c5-c53e-4c1d-af14-ed51bcb3817a_qeswxab2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31 {{(pid=93497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 11:25:24 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Converted 0.00 MB image at 0.00 MB/s Jun 29 11:25:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:24 devstack sudo[112703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31 1G Jun 29 11:25:24 devstack sudo[112703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:24 devstack sudo[112703]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:24 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31 1G" returned: 0 in 0.669s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:25 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d16b691-57a6-4720-ae02-2178b98b7cc0]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:25:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:25 devstack sudo[112708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31 Jun 29 11:25:25 devstack sudo[112708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:25 devstack sudo[112708]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31" returned: 0 in 0.734s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:25 devstack sudo[112713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31 Jun 29 11:25:25 devstack sudo[112713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:26 devstack sudo[112713]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31" returned: 1 in 0.751s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:25:26 devstack cinder-volume[93497]: DEBUG cinder.volume.volume_utils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Downloaded image edb7c9c5-c53e-4c1d-af14-ed51bcb3817a ((None, [{'url': 'file:///opt/stack/data/glance/images/edb7c9c5-c53e-4c1d-af14-ed51bcb3817a', 'metadata': {}}])) to volume f8ed9cce-5352-4fd4-a1bc-a19ee839bf31 successfully. {{(pid=93497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 29 11:25:26 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Temporary image edb7c9c5-c53e-4c1d-af14-ed51bcb3817a for user d3d13a887d554c059e38b8b709747c0a is deleted. {{(pid=93497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 29 11:25:26 devstack cinder-volume[93497]: DEBUG cinder.volume.volume_utils [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Marking volume f8ed9cce-5352-4fd4-a1bc-a19ee839bf31 as bootable. {{(pid=93497) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 29 11:25:26 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Copying metadata from image edb7c9c5-c53e-4c1d-af14-ed51bcb3817a to f8ed9cce-5352-4fd4-a1bc-a19ee839bf31. {{(pid=93497) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 29 11:25:26 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Creating volume glance metadata for volume f8ed9cce-5352-4fd4-a1bc-a19ee839bf31 backed by image edb7c9c5-c53e-4c1d-af14-ed51bcb3817a with: {'image_id': 'edb7c9c5-c53e-4c1d-af14-ed51bcb3817a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'aa0e12f9e46ecf9d594e30e0d79e4946', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93497) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 29 11:25:26 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (570764f8-0f4f-4e0b-8ea0-ad6685e5f871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31', 'volume_size': 1, 'image_id': 'edb7c9c5-c53e-4c1d-af14-ed51bcb3817a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edb7c9c5-c53e-4c1d-af14-ed51bcb3817a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'aa0e12f9e46ecf9d594e30e0d79e4946', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '63befb14fc494362af438e95b0e8e422', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3746115fce6fc8a11963099f9c61d0d7ffeb4cd3936a4920aef158bb96f530c4f8ff4e1d0b1fb6a41e5f178a7be571cf824622dcc8d8342ff9bef46c6f4dff74', 'id': 'edb7c9c5-c53e-4c1d-af14-ed51bcb3817a', 'created_at': datetime.datetime(2026, 6, 29, 9, 25, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 9, 25, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edb7c9c5-c53e-4c1d-af14-ed51bcb3817a/file', 'properties': {}}, 'image_service': }' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:25:26 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ece634-0bdf-4eba-a6ad-f62fcb6be81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:25:26 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Volume volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31 (f8ed9cce-5352-4fd4-a1bc-a19ee839bf31): created successfully Jun 29 11:25:26 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ece634-0bdf-4eba-a6ad-f62fcb6be81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:25:26 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Flow 'volume_create_manager' (44c924c8-5ca6-4fe3-afc4-c9a705767964) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:25:26 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-cf388b11-8549-45c9-8f9d-60976ffd5b74 tempest-VolumeImageDependencyTests-1947262754 None] Created volume successfully. Jun 29 11:25:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-db5702e3-69da-4cd4-a493-0bb95ae04dd7 tempest-VolumeImageDependencyTests-1947262754 None] Acquiring lock "cinder-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:25:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-db5702e3-69da-4cd4-a493-0bb95ae04dd7 tempest-VolumeImageDependencyTests-1947262754 None] Lock "cinder-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:25:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-db5702e3-69da-4cd4-a493-0bb95ae04dd7 tempest-VolumeImageDependencyTests-1947262754 None] Acquiring lock "cinder-quobyte-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:25:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-db5702e3-69da-4cd4-a493-0bb95ae04dd7 tempest-VolumeImageDependencyTests-1947262754 None] Lock "cinder-quobyte-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31" acquired by "delete_volume" :: waited 0.013s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:25:27 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[deab1967-46be-484f-8b87-6327c18fb44e]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:25:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-db5702e3-69da-4cd4-a493-0bb95ae04dd7 tempest-VolumeImageDependencyTests-1947262754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:27 devstack sudo[112718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31 Jun 29 11:25:27 devstack sudo[112718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:28 devstack sudo[112718]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-db5702e3-69da-4cd4-a493-0bb95ae04dd7 tempest-VolumeImageDependencyTests-1947262754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31" returned: 0 in 0.761s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-db5702e3-69da-4cd4-a493-0bb95ae04dd7 tempest-VolumeImageDependencyTests-1947262754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:28 devstack sudo[112723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31 Jun 29 11:25:28 devstack sudo[112723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:28 devstack sudo[112723]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-db5702e3-69da-4cd4-a493-0bb95ae04dd7 tempest-VolumeImageDependencyTests-1947262754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31" returned: 1 in 0.776s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-db5702e3-69da-4cd4-a493-0bb95ae04dd7 tempest-VolumeImageDependencyTests-1947262754 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:25:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-db5702e3-69da-4cd4-a493-0bb95ae04dd7 tempest-VolumeImageDependencyTests-1947262754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:28 devstack sudo[112728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31 Jun 29 11:25:28 devstack sudo[112728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:29 devstack sudo[112728]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-db5702e3-69da-4cd4-a493-0bb95ae04dd7 tempest-VolumeImageDependencyTests-1947262754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31" returned: 0 in 0.645s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:29 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-db5702e3-69da-4cd4-a493-0bb95ae04dd7 tempest-VolumeImageDependencyTests-1947262754 None] Lock "cinder-quobyte-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31" released by "delete_volume" :: held 2.243s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:25:29 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-db5702e3-69da-4cd4-a493-0bb95ae04dd7 tempest-VolumeImageDependencyTests-1947262754 None] Created reservations ['4b26d2f2-8389-4145-84ae-b3db15d32d55', '5dbf1237-3409-45e1-a290-2464f5326297', 'b06541b6-0667-43f1-9aa6-5c3c0bb45af7', '696d5f9f-6ebe-4f96-87ee-6321ca3c0411'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:25:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-db5702e3-69da-4cd4-a493-0bb95ae04dd7 tempest-VolumeImageDependencyTests-1947262754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:25:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-db5702e3-69da-4cd4-a493-0bb95ae04dd7 tempest-VolumeImageDependencyTests-1947262754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:25:29 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-db5702e3-69da-4cd4-a493-0bb95ae04dd7 tempest-VolumeImageDependencyTests-1947262754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:25:29 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-db5702e3-69da-4cd4-a493-0bb95ae04dd7 tempest-VolumeImageDependencyTests-1947262754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:25:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-db5702e3-69da-4cd4-a493-0bb95ae04dd7 tempest-VolumeImageDependencyTests-1947262754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:25:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-db5702e3-69da-4cd4-a493-0bb95ae04dd7 tempest-VolumeImageDependencyTests-1947262754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:29 devstack sudo[112731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:25:29 devstack sudo[112731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:30 devstack sudo[112731]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-db5702e3-69da-4cd4-a493-0bb95ae04dd7 tempest-VolumeImageDependencyTests-1947262754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.663s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:30 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-db5702e3-69da-4cd4-a493-0bb95ae04dd7 tempest-VolumeImageDependencyTests-1947262754 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:25:30 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-db5702e3-69da-4cd4-a493-0bb95ae04dd7 tempest-VolumeImageDependencyTests-1947262754 None] Deleted volume successfully. Jun 29 11:25:30 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=71,cinder:UPDATE=97,cinder:DELETE=12,cinder:INSERT=25 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:25:30 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-db5702e3-69da-4cd4-a493-0bb95ae04dd7 tempest-VolumeImageDependencyTests-1947262754 None] Lock "cinder-f8ed9cce-5352-4fd4-a1bc-a19ee839bf31-delete_volume" released by "delete_volume" :: held 3.107s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:25:34 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=74,cinder:INSERT=28,cinder:UPDATE=99,cinder:DELETE=6 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:25:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-a3d79c6d-927c-4013-b135-91cfd5589067 req-af8ddd2d-bbe9-42d2-b99e-06442752a9d4 tempest-TestStampPattern-2118674922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:25:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-a3d79c6d-927c-4013-b135-91cfd5589067 req-af8ddd2d-bbe9-42d2-b99e-06442752a9d4 tempest-TestStampPattern-2118674922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:25:34 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2ace3e-fc3d-446b-b7b6-5a874bdbf6d8]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:25:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-a3d79c6d-927c-4013-b135-91cfd5589067 req-af8ddd2d-bbe9-42d2-b99e-06442752a9d4 tempest-TestStampPattern-2118674922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5f008307-b074-4da9-9a08-a2e4351bb958 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:34 devstack sudo[112746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5f008307-b074-4da9-9a08-a2e4351bb958 Jun 29 11:25:34 devstack sudo[112746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:35 devstack sudo[112746]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [req-a3d79c6d-927c-4013-b135-91cfd5589067 req-af8ddd2d-bbe9-42d2-b99e-06442752a9d4 tempest-TestStampPattern-2118674922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5f008307-b074-4da9-9a08-a2e4351bb958" returned: 0 in 0.816s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [req-a3d79c6d-927c-4013-b135-91cfd5589067 req-af8ddd2d-bbe9-42d2-b99e-06442752a9d4 tempest-TestStampPattern-2118674922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.840s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:25:35 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-a3d79c6d-927c-4013-b135-91cfd5589067 req-af8ddd2d-bbe9-42d2-b99e-06442752a9d4 tempest-TestStampPattern-2118674922 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3', 'name': 'volume-5f008307-b074-4da9-9a08-a2e4351bb958', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3912ea57-0757-41c1-b4fa-110e4cdf2d2f', 'enforce_multipath': True} {{(pid=93497) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 11:25:35 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-a3d79c6d-927c-4013-b135-91cfd5589067 req-af8ddd2d-bbe9-42d2-b99e-06442752a9d4 tempest-TestStampPattern-2118674922 None] attachment_update completed successfully. Jun 29 11:25:42 devstack cinder-volume[93497]: INFO cinder.volume.manager [req-ebc36ebd-0872-47e1-8c23-f0a8da600896 req-31c7d9bd-64fe-490f-bf28-eb7adee913c3 tempest-TestStampPattern-2118674922 None] Terminate volume connection completed successfully. Jun 29 11:25:42 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [req-ebc36ebd-0872-47e1-8c23-f0a8da600896 req-31c7d9bd-64fe-490f-bf28-eb7adee913c3 tempest-TestStampPattern-2118674922 None] Deleting attachment 3912ea57-0757-41c1-b4fa-110e4cdf2d2f. {{(pid=93497) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 11:25:52 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2c330999-d187-4bbd-8e0d-5955c85a0f0a tempest-TestStampPattern-2118674922 None] Acquiring lock "cinder-5f008307-b074-4da9-9a08-a2e4351bb958-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:25:52 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2c330999-d187-4bbd-8e0d-5955c85a0f0a tempest-TestStampPattern-2118674922 None] Lock "cinder-5f008307-b074-4da9-9a08-a2e4351bb958-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:25:52 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2c330999-d187-4bbd-8e0d-5955c85a0f0a tempest-TestStampPattern-2118674922 None] Acquiring lock "cinder-quobyte-5f008307-b074-4da9-9a08-a2e4351bb958" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:25:52 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2c330999-d187-4bbd-8e0d-5955c85a0f0a tempest-TestStampPattern-2118674922 None] Lock "cinder-quobyte-5f008307-b074-4da9-9a08-a2e4351bb958" acquired by "delete_volume" :: waited 0.021s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:25:52 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbc3977-964e-4b2b-a658-68e884a7584b]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:25:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2c330999-d187-4bbd-8e0d-5955c85a0f0a tempest-TestStampPattern-2118674922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5f008307-b074-4da9-9a08-a2e4351bb958 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:52 devstack sudo[113229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5f008307-b074-4da9-9a08-a2e4351bb958 Jun 29 11:25:52 devstack sudo[113229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:53 devstack sudo[113229]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2c330999-d187-4bbd-8e0d-5955c85a0f0a tempest-TestStampPattern-2118674922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5f008307-b074-4da9-9a08-a2e4351bb958" returned: 0 in 0.910s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2c330999-d187-4bbd-8e0d-5955c85a0f0a tempest-TestStampPattern-2118674922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5f008307-b074-4da9-9a08-a2e4351bb958 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:53 devstack sudo[113234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5f008307-b074-4da9-9a08-a2e4351bb958 Jun 29 11:25:53 devstack sudo[113234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:53 devstack sudo[113234]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2c330999-d187-4bbd-8e0d-5955c85a0f0a tempest-TestStampPattern-2118674922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5f008307-b074-4da9-9a08-a2e4351bb958" returned: 0 in 0.693s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:53 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2c330999-d187-4bbd-8e0d-5955c85a0f0a tempest-TestStampPattern-2118674922 None] Lock "cinder-quobyte-5f008307-b074-4da9-9a08-a2e4351bb958" released by "delete_volume" :: held 1.671s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-2c330999-d187-4bbd-8e0d-5955c85a0f0a tempest-TestStampPattern-2118674922 None] Created reservations ['54652b7e-fe55-4e3b-aa04-2ee9f5daccda', '7b7099cb-befa-4b45-a0ca-7ea270a3c8ee', '2025eba9-8a10-43f5-9d12-9c920fcbefa4', 'cfbcb019-deb9-4f60-99b9-b4e2b80ae2c4'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2c330999-d187-4bbd-8e0d-5955c85a0f0a tempest-TestStampPattern-2118674922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2c330999-d187-4bbd-8e0d-5955c85a0f0a tempest-TestStampPattern-2118674922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2c330999-d187-4bbd-8e0d-5955c85a0f0a tempest-TestStampPattern-2118674922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2c330999-d187-4bbd-8e0d-5955c85a0f0a tempest-TestStampPattern-2118674922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2c330999-d187-4bbd-8e0d-5955c85a0f0a tempest-TestStampPattern-2118674922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2c330999-d187-4bbd-8e0d-5955c85a0f0a tempest-TestStampPattern-2118674922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:25:54 devstack sudo[113237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:25:54 devstack sudo[113237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] Flow 'volume_create_manager' (4c74d784-09d0-4df7-a123-e390676981e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (922244e3-ac49-4f6f-bb31-ad2ca961967b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (922244e3-ac49-4f6f-bb31-ad2ca961967b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-454262183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6ec7d78-44a1-4a23-b81f-bce4e3de025a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7df1932f35504229a80c60ddfc35c32b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:25:54Z,use_quota=True,user_id='63d4c79acfe4402187930e56b4fa29a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1817681-c643-4922-a442-8bc236f22c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1817681-c643-4922-a442-8bc236f22c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a002fd5f-1b68-4565-983f-064c970f2d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a002fd5f-1b68-4565-983f-064c970f2d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6ec7d78-44a1-4a23-b81f-bce4e3de025a', 'volume_name': 'volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c6d16a7-4ab6-4a64-9ab9-22939cf54ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c6d16a7-4ab6-4a64-9ab9-22939cf54ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10155cb-d0ba-43e6-be1e-6a3696df0e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:25:54 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] Volume a6ec7d78-44a1-4a23-b81f-bce4e3de025a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a', 'volume_size': 1} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-454262183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6ec7d78-44a1-4a23-b81f-bce4e3de025a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7df1932f35504229a80c60ddfc35c32b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:25:54Z,use_quota=True,user_id='63d4c79acfe4402187930e56b4fa29a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] Creating volume a6ec7d78-44a1-4a23-b81f-bce4e3de025a {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:25:54 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:54 devstack sudo[113239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a 1073741824 Jun 29 11:25:54 devstack sudo[113239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e6177785-12df-479c-8947-406201a8822d tempest-TestStampPattern-2118674922 None] Acquiring lock "cinder-5c7a3c0c-2cda-46be-ae67-ca95679aa129-delete_snapshot" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:25:54 devstack sudo[113237]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2c330999-d187-4bbd-8e0d-5955c85a0f0a tempest-TestStampPattern-2118674922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.725s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-2c330999-d187-4bbd-8e0d-5955c85a0f0a tempest-TestStampPattern-2118674922 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e6177785-12df-479c-8947-406201a8822d tempest-TestStampPattern-2118674922 None] Lock "cinder-5c7a3c0c-2cda-46be-ae67-ca95679aa129-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e6177785-12df-479c-8947-406201a8822d tempest-TestStampPattern-2118674922 None] Acquiring lock "cinder-quobyte-f5028f72-8569-4b03-aa99-e8087f7f0daf" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:25:54 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-2c330999-d187-4bbd-8e0d-5955c85a0f0a tempest-TestStampPattern-2118674922 None] Deleted volume successfully. Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2c330999-d187-4bbd-8e0d-5955c85a0f0a tempest-TestStampPattern-2118674922 None] Lock "cinder-5f008307-b074-4da9-9a08-a2e4351bb958-delete_volume" released by "delete_volume" :: held 2.612s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e6177785-12df-479c-8947-406201a8822d tempest-TestStampPattern-2118674922 None] Lock "cinder-quobyte-f5028f72-8569-4b03-aa99-e8087f7f0daf" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e6177785-12df-479c-8947-406201a8822d tempest-TestStampPattern-2118674922 None] Acquiring lock "cinder-quobyte-5c7a3c0c-2cda-46be-ae67-ca95679aa129" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e6177785-12df-479c-8947-406201a8822d tempest-TestStampPattern-2118674922 None] Lock "cinder-quobyte-5c7a3c0c-2cda-46be-ae67-ca95679aa129" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-e6177785-12df-479c-8947-406201a8822d tempest-TestStampPattern-2118674922 None] Deleting offline snapshot 5c7a3c0c-2cda-46be-ae67-ca95679aa129 of volume f5028f72-8569-4b03-aa99-e8087f7f0daf {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-e6177785-12df-479c-8947-406201a8822d tempest-TestStampPattern-2118674922 None] snapshot_file for this snap is: volume-f5028f72-8569-4b03-aa99-e8087f7f0daf.5c7a3c0c-2cda-46be-ae67-ca95679aa129 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[980fc5c9-d9c2-4196-aeea-f3f7bd45e0ba]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:25:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e6177785-12df-479c-8947-406201a8822d tempest-TestStampPattern-2118674922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf.5c7a3c0c-2cda-46be-ae67-ca95679aa129 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:55 devstack sudo[113245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf.5c7a3c0c-2cda-46be-ae67-ca95679aa129 Jun 29 11:25:55 devstack sudo[113245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:55 devstack sudo[113239]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a 1073741824" returned: 0 in 0.894s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:55 devstack sudo[113247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a Jun 29 11:25:55 devstack sudo[113247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:55 devstack sudo[113245]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e6177785-12df-479c-8947-406201a8822d tempest-TestStampPattern-2118674922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf.5c7a3c0c-2cda-46be-ae67-ca95679aa129" returned: 0 in 0.838s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:55 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-e6177785-12df-479c-8947-406201a8822d tempest-TestStampPattern-2118674922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5028f72-8569-4b03-aa99-e8087f7f0daf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:25:55 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9c7ce7-cfa0-45d7-bf39-db2ee0802af2]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:25:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e6177785-12df-479c-8947-406201a8822d tempest-TestStampPattern-2118674922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:55 devstack sudo[113247]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a" returned: 0 in 0.654s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:55 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:25:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:25:55 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10155cb-d0ba-43e6-be1e-6a3696df0e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:25:55 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b315d76-6bbc-4e77-af4f-176ad0e95c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:25:55 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] Volume volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a (a6ec7d78-44a1-4a23-b81f-bce4e3de025a): created successfully Jun 29 11:25:55 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b315d76-6bbc-4e77-af4f-176ad0e95c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:25:55 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] Flow 'volume_create_manager' (4c74d784-09d0-4df7-a123-e390676981e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:25:55 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-8085a057-c792-4ba2-9ae0-22797283787d tempest-SnapshotDependencyTests-1002514706 None] Created volume successfully. Jun 29 11:25:55 devstack sudo[113253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf Jun 29 11:25:55 devstack sudo[113253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f4529ed8-dab3-4253-ace3-b84e458f5d44 tempest-SnapshotDependencyTests-1002514706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:25:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f4529ed8-dab3-4253-ace3-b84e458f5d44 tempest-SnapshotDependencyTests-1002514706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:25:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-f4529ed8-dab3-4253-ace3-b84e458f5d44 tempest-SnapshotDependencyTests-1002514706 None] Creating offline snapshot e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033 of volume a6ec7d78-44a1-4a23-b81f-bce4e3de025a {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:25:56 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9ecde7-842c-4d0b-bba0-37d8359771a6]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:25:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f4529ed8-dab3-4253-ace3-b84e458f5d44 tempest-SnapshotDependencyTests-1002514706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:56 devstack sudo[113253]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e6177785-12df-479c-8947-406201a8822d tempest-TestStampPattern-2118674922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf" returned: 0 in 0.792s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e6177785-12df-479c-8947-406201a8822d tempest-TestStampPattern-2118674922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf.5c7a3c0c-2cda-46be-ae67-ca95679aa129 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:56 devstack sudo[113260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf.5c7a3c0c-2cda-46be-ae67-ca95679aa129 Jun 29 11:25:56 devstack sudo[113260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:56 devstack sudo[113259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a Jun 29 11:25:56 devstack sudo[113259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:57 devstack sudo[113259]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f4529ed8-dab3-4253-ace3-b84e458f5d44 tempest-SnapshotDependencyTests-1002514706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a" returned: 0 in 0.773s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f4529ed8-dab3-4253-ace3-b84e458f5d44 tempest-SnapshotDependencyTests-1002514706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a.e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:57 devstack sudo[113269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a.e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033 1G Jun 29 11:25:57 devstack sudo[113269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:57 devstack sudo[113260]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e6177785-12df-479c-8947-406201a8822d tempest-TestStampPattern-2118674922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf.5c7a3c0c-2cda-46be-ae67-ca95679aa129" returned: 0 in 0.765s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e6177785-12df-479c-8947-406201a8822d tempest-TestStampPattern-2118674922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf.5c7a3c0c-2cda-46be-ae67-ca95679aa129 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:57 devstack sudo[113285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf.5c7a3c0c-2cda-46be-ae67-ca95679aa129 Jun 29 11:25:57 devstack sudo[113285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:57 devstack sudo[113285]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e6177785-12df-479c-8947-406201a8822d tempest-TestStampPattern-2118674922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf.5c7a3c0c-2cda-46be-ae67-ca95679aa129" returned: 0 in 0.640s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:58 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e6177785-12df-479c-8947-406201a8822d tempest-TestStampPattern-2118674922 None] Lock "cinder-quobyte-5c7a3c0c-2cda-46be-ae67-ca95679aa129" released by "_delete_snapshot" :: held 3.147s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:25:58 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e6177785-12df-479c-8947-406201a8822d tempest-TestStampPattern-2118674922 None] Lock "cinder-quobyte-f5028f72-8569-4b03-aa99-e8087f7f0daf" released by "delete_snapshot" :: held 3.174s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:25:58 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-e6177785-12df-479c-8947-406201a8822d tempest-TestStampPattern-2118674922 None] Created reservations ['293e98a9-fa82-44f4-8b3c-8187ba10a29c', '3fb638c6-7e8b-4a82-910d-eac89e7cef2d', '8e07e623-179a-4d52-8198-35c72a7507de', '5f27ffea-23ec-43bf-a9f4-7ab85a0753d8'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:25:58 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-e6177785-12df-479c-8947-406201a8822d tempest-TestStampPattern-2118674922 None] Delete snapshot completed successfully. Jun 29 11:25:58 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e6177785-12df-479c-8947-406201a8822d tempest-TestStampPattern-2118674922 None] Lock "cinder-5c7a3c0c-2cda-46be-ae67-ca95679aa129-delete_snapshot" released by "delete_snapshot" :: held 3.372s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:25:58 devstack sudo[113269]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f4529ed8-dab3-4253-ace3-b84e458f5d44 tempest-SnapshotDependencyTests-1002514706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a.e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033 1G" returned: 0 in 0.945s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f4529ed8-dab3-4253-ace3-b84e458f5d44 tempest-SnapshotDependencyTests-1002514706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a.e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:58 devstack sudo[113315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a.e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033 Jun 29 11:25:58 devstack sudo[113315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:58 devstack sudo[113315]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f4529ed8-dab3-4253-ace3-b84e458f5d44 tempest-SnapshotDependencyTests-1002514706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a.e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033" returned: 0 in 0.659s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:58 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-f4529ed8-dab3-4253-ace3-b84e458f5d44 tempest-SnapshotDependencyTests-1002514706 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a.e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033 is being set with open permissions: ugo+rw Jun 29 11:25:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f4529ed8-dab3-4253-ace3-b84e458f5d44 tempest-SnapshotDependencyTests-1002514706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a.e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:58 devstack sudo[113321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a.e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033 Jun 29 11:25:58 devstack sudo[113321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:25:59 devstack sudo[113321]: pam_unix(sudo:session): session closed for user root Jun 29 11:25:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f4529ed8-dab3-4253-ace3-b84e458f5d44 tempest-SnapshotDependencyTests-1002514706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a.e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033" returned: 0 in 0.659s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:25:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f4529ed8-dab3-4253-ace3-b84e458f5d44 tempest-SnapshotDependencyTests-1002514706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:25:59 devstack sudo[113324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a.info Jun 29 11:25:59 devstack sudo[113324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:00 devstack sudo[113324]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f4529ed8-dab3-4253-ace3-b84e458f5d44 tempest-SnapshotDependencyTests-1002514706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a.info" returned: 0 in 0.693s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:00 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-f4529ed8-dab3-4253-ace3-b84e458f5d44 tempest-SnapshotDependencyTests-1002514706 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a.info is being set with open permissions: ugo+rw Jun 29 11:26:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f4529ed8-dab3-4253-ace3-b84e458f5d44 tempest-SnapshotDependencyTests-1002514706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:00 devstack sudo[113329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a.info Jun 29 11:26:00 devstack sudo[113329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:00 devstack sudo[113329]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f4529ed8-dab3-4253-ace3-b84e458f5d44 tempest-SnapshotDependencyTests-1002514706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a.info" returned: 0 in 0.630s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f4529ed8-dab3-4253-ace3-b84e458f5d44 tempest-SnapshotDependencyTests-1002514706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.445s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:00 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-f4529ed8-dab3-4253-ace3-b84e458f5d44 tempest-SnapshotDependencyTests-1002514706 None] Create snapshot completed successfully Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Flow 'volume_create_manager' (6bc9bd69-989f-42b2-b532-5182778ff2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a6c3cb9-8048-413d-a4ad-e7be06d3d10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a6c3cb9-8048-413d-a4ad-e7be06d3d10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8533fe39-ccd0-4e98-a13d-43873452e72b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7df1932f35504229a80c60ddfc35c32b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:26:02Z,use_quota=True,user_id='63d4c79acfe4402187930e56b4fa29a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a848d0ab-ce9e-41a4-b024-784e1aea18d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a848d0ab-ce9e-41a4-b024-784e1aea18d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d636fce6-c330-409a-95c2-84dc9689d641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d636fce6-c330-409a-95c2-84dc9689d641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8533fe39-ccd0-4e98-a13d-43873452e72b', 'volume_name': 'volume-8533fe39-ccd0-4e98-a13d-43873452e72b', 'volume_size': 1, 'snapshot_id': 'e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033'}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c816d03f-1fe2-4825-99e3-a893cab697b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c816d03f-1fe2-4825-99e3-a893cab697b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676cbdba-75d8-4ad4-82cd-71638e9f4c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:02 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Volume 8533fe39-ccd0-4e98-a13d-43873452e72b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8533fe39-ccd0-4e98-a13d-43873452e72b', 'volume_size': 1, 'snapshot_id': 'e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033'} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Acquiring lock "cinder-quobyte-e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033-8533fe39-ccd0-4e98-a13d-43873452e72b" by "_create_volume_from_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Lock "cinder-quobyte-e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033-8533fe39-ccd0-4e98-a13d-43873452e72b" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Creating volume 8533fe39-ccd0-4e98-a13d-43873452e72b from snapshot e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033 {{(pid=93497) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Acquiring lock "cinder-quobyte-8533fe39-ccd0-4e98-a13d-43873452e72b" by "_copy_volume_from_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Lock "cinder-quobyte-8533fe39-ccd0-4e98-a13d-43873452e72b" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] snapshot: e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033, volume: 8533fe39-ccd0-4e98-a13d-43873452e72b, {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c611681c-1787-4bd3-b1d8-3864465d1b3c]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:26:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a.e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:02 devstack sudo[113376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a.e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033 Jun 29 11:26:02 devstack sudo[113376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:03 devstack sudo[113376]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a.e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033" returned: 0 in 0.828s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:03 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:26:03 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 11:26:03 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Creating direct copy from snapshot {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 11:26:03 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9314f068-f34b-42ad-a280-f418b65e6ce2]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:26:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:03 devstack sudo[113382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a Jun 29 11:26:03 devstack sudo[113382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:04 devstack sudo[113382]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a" returned: 0 in 0.774s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:04 devstack cinder-volume[93497]: DEBUG cinder.utils [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Path /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8533fe39-ccd0-4e98-a13d-43873452e72b not found in is_blk_device check {{(pid=93497) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 11:26:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8533fe39-ccd0-4e98-a13d-43873452e72b {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:04 devstack sudo[113387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8533fe39-ccd0-4e98-a13d-43873452e72b Jun 29 11:26:04 devstack sudo[113387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1e1e3363-328b-43d6-bab2-44724b135768 tempest-TestStampPattern-2118674922 None] Acquiring lock "cinder-f5028f72-8569-4b03-aa99-e8087f7f0daf-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:26:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1e1e3363-328b-43d6-bab2-44724b135768 tempest-TestStampPattern-2118674922 None] Lock "cinder-f5028f72-8569-4b03-aa99-e8087f7f0daf-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:26:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1e1e3363-328b-43d6-bab2-44724b135768 tempest-TestStampPattern-2118674922 None] Acquiring lock "cinder-quobyte-f5028f72-8569-4b03-aa99-e8087f7f0daf" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:26:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1e1e3363-328b-43d6-bab2-44724b135768 tempest-TestStampPattern-2118674922 None] Lock "cinder-quobyte-f5028f72-8569-4b03-aa99-e8087f7f0daf" acquired by "delete_volume" :: waited 0.047s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:26:06 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a281344-37e0-444e-9731-4e37165b57df]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:26:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1e1e3363-328b-43d6-bab2-44724b135768 tempest-TestStampPattern-2118674922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:07 devstack sudo[113399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf Jun 29 11:26:07 devstack sudo[113399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:08 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:26:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:26:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:26:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:08 devstack sudo[113405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:26:08 devstack sudo[113405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:08 devstack sudo[113399]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1e1e3363-328b-43d6-bab2-44724b135768 tempest-TestStampPattern-2118674922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf" returned: 0 in 1.441s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1e1e3363-328b-43d6-bab2-44724b135768 tempest-TestStampPattern-2118674922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:08 devstack sudo[113408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf Jun 29 11:26:08 devstack sudo[113408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:09 devstack sudo[113387]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8533fe39-ccd0-4e98-a13d-43873452e72b" returned: 0 in 5.089s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:09 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f946d9-cd89-43b9-906f-c4c523a65b0a]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:26:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:09 devstack sudo[113405]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.135s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:09 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:26:09 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager._thread_info {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:26:09 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread count: 29 {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 11:26:09 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread info: [<_MainThread(MainThread, started 131117520400512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 11:26:09 devstack sudo[113411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a Jun 29 11:26:09 devstack sudo[113411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:09 devstack sudo[113408]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1e1e3363-328b-43d6-bab2-44724b135768 tempest-TestStampPattern-2118674922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f5028f72-8569-4b03-aa99-e8087f7f0daf" returned: 0 in 1.094s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1e1e3363-328b-43d6-bab2-44724b135768 tempest-TestStampPattern-2118674922 None] Lock "cinder-quobyte-f5028f72-8569-4b03-aa99-e8087f7f0daf" released by "delete_volume" :: held 2.641s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:26:09 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-1e1e3363-328b-43d6-bab2-44724b135768 tempest-TestStampPattern-2118674922 None] Created reservations ['c02744fb-4d81-4cdc-be2f-b15f9d25ce67', '68489ac0-bddb-4b0e-b8ef-ba392b8d678f', 'cb078c91-aba1-4a4e-9c6e-9d315f2ed9a4', '8c02d368-d760-4cd4-96ad-afc22a873669'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:26:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1e1e3363-328b-43d6-bab2-44724b135768 tempest-TestStampPattern-2118674922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1e1e3363-328b-43d6-bab2-44724b135768 tempest-TestStampPattern-2118674922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:09 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1e1e3363-328b-43d6-bab2-44724b135768 tempest-TestStampPattern-2118674922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:26:09 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1e1e3363-328b-43d6-bab2-44724b135768 tempest-TestStampPattern-2118674922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:26:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1e1e3363-328b-43d6-bab2-44724b135768 tempest-TestStampPattern-2118674922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1e1e3363-328b-43d6-bab2-44724b135768 tempest-TestStampPattern-2118674922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:09 devstack sudo[113414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:26:09 devstack sudo[113414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:10 devstack sudo[113411]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a" returned: 0 in 0.973s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:10 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Image conversion details: src /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a, size 1024.00 MB, duration 5.09 sec, destination /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8533fe39-ccd0-4e98-a13d-43873452e72b {{(pid=93497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 11:26:10 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Converted 1024.00 MB image at 201.16 MB/s Jun 29 11:26:10 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8533fe39-ccd0-4e98-a13d-43873452e72b is being set with open permissions: ugo+rw Jun 29 11:26:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8533fe39-ccd0-4e98-a13d-43873452e72b {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:10 devstack sudo[113419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8533fe39-ccd0-4e98-a13d-43873452e72b Jun 29 11:26:10 devstack sudo[113419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:10 devstack sudo[113414]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1e1e3363-328b-43d6-bab2-44724b135768 tempest-TestStampPattern-2118674922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.679s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:10 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-1e1e3363-328b-43d6-bab2-44724b135768 tempest-TestStampPattern-2118674922 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:26:10 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-1e1e3363-328b-43d6-bab2-44724b135768 tempest-TestStampPattern-2118674922 None] Deleted volume successfully. Jun 29 11:26:10 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1e1e3363-328b-43d6-bab2-44724b135768 tempest-TestStampPattern-2118674922 None] Lock "cinder-f5028f72-8569-4b03-aa99-e8087f7f0daf-delete_volume" released by "delete_volume" :: held 3.607s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:26:10 devstack sudo[113419]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8533fe39-ccd0-4e98-a13d-43873452e72b" returned: 0 in 0.674s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:10 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Lock "cinder-quobyte-8533fe39-ccd0-4e98-a13d-43873452e72b" released by "_copy_volume_from_snapshot" :: held 8.453s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:26:10 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Lock "cinder-quobyte-e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033-8533fe39-ccd0-4e98-a13d-43873452e72b" released by "_create_volume_from_snapshot" :: held 8.487s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:26:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.503s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:10 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676cbdba-75d8-4ad4-82cd-71638e9f4c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8533fe39-ccd0-4e98-a13d-43873452e72b', 'volume_size': 1, 'snapshot_id': 'e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033'}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:10 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae14e00f-681e-4601-93a5-88446403160d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:10 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Volume volume-8533fe39-ccd0-4e98-a13d-43873452e72b (8533fe39-ccd0-4e98-a13d-43873452e72b): created successfully Jun 29 11:26:10 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae14e00f-681e-4601-93a5-88446403160d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:10 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Flow 'volume_create_manager' (6bc9bd69-989f-42b2-b532-5182778ff2cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:26:10 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-79bacee4-448e-4ea6-96d3-c99720b5c64f tempest-SnapshotDependencyTests-1002514706 None] Created volume successfully. Jun 29 11:26:11 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3c90446a-c16e-4232-9f27-ab7f10cf94e4 tempest-SnapshotDependencyTests-1002514706 None] Acquiring lock "cinder-e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033-delete_snapshot" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:26:11 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3c90446a-c16e-4232-9f27-ab7f10cf94e4 tempest-SnapshotDependencyTests-1002514706 None] Lock "cinder-e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:26:11 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3c90446a-c16e-4232-9f27-ab7f10cf94e4 tempest-SnapshotDependencyTests-1002514706 None] Acquiring lock "cinder-quobyte-a6ec7d78-44a1-4a23-b81f-bce4e3de025a" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:26:11 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3c90446a-c16e-4232-9f27-ab7f10cf94e4 tempest-SnapshotDependencyTests-1002514706 None] Lock "cinder-quobyte-a6ec7d78-44a1-4a23-b81f-bce4e3de025a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:26:11 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3c90446a-c16e-4232-9f27-ab7f10cf94e4 tempest-SnapshotDependencyTests-1002514706 None] Acquiring lock "cinder-quobyte-e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:26:11 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3c90446a-c16e-4232-9f27-ab7f10cf94e4 tempest-SnapshotDependencyTests-1002514706 None] Lock "cinder-quobyte-e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:26:11 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-3c90446a-c16e-4232-9f27-ab7f10cf94e4 tempest-SnapshotDependencyTests-1002514706 None] Deleting offline snapshot e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033 of volume a6ec7d78-44a1-4a23-b81f-bce4e3de025a {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:26:11 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-3c90446a-c16e-4232-9f27-ab7f10cf94e4 tempest-SnapshotDependencyTests-1002514706 None] snapshot_file for this snap is: volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a.e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:26:11 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[877e87d8-91e7-4da8-923e-11bb10a7c4d1]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:26:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3c90446a-c16e-4232-9f27-ab7f10cf94e4 tempest-SnapshotDependencyTests-1002514706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a.e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:11 devstack sudo[113423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a.e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033 Jun 29 11:26:11 devstack sudo[113423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:11 devstack sudo[113423]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3c90446a-c16e-4232-9f27-ab7f10cf94e4 tempest-SnapshotDependencyTests-1002514706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a.e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033" returned: 0 in 0.809s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:11 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-3c90446a-c16e-4232-9f27-ab7f10cf94e4 tempest-SnapshotDependencyTests-1002514706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:26:11 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f708889e-daef-4070-b46a-b1c39874f120]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:26:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3c90446a-c16e-4232-9f27-ab7f10cf94e4 tempest-SnapshotDependencyTests-1002514706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:12 devstack sudo[113429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a Jun 29 11:26:12 devstack sudo[113429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:12 devstack sudo[113429]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3c90446a-c16e-4232-9f27-ab7f10cf94e4 tempest-SnapshotDependencyTests-1002514706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a" returned: 0 in 0.815s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3c90446a-c16e-4232-9f27-ab7f10cf94e4 tempest-SnapshotDependencyTests-1002514706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a.e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:12 devstack sudo[113434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a.e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033 Jun 29 11:26:12 devstack sudo[113434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:13 devstack sudo[113434]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3c90446a-c16e-4232-9f27-ab7f10cf94e4 tempest-SnapshotDependencyTests-1002514706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a.e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033" returned: 0 in 0.864s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3c90446a-c16e-4232-9f27-ab7f10cf94e4 tempest-SnapshotDependencyTests-1002514706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a.e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:13 devstack sudo[113441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a.e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033 Jun 29 11:26:13 devstack sudo[113441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:14 devstack sudo[113441]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3c90446a-c16e-4232-9f27-ab7f10cf94e4 tempest-SnapshotDependencyTests-1002514706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a.e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033" returned: 0 in 0.711s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:14 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3c90446a-c16e-4232-9f27-ab7f10cf94e4 tempest-SnapshotDependencyTests-1002514706 None] Lock "cinder-quobyte-e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033" released by "_delete_snapshot" :: held 3.308s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:26:14 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3c90446a-c16e-4232-9f27-ab7f10cf94e4 tempest-SnapshotDependencyTests-1002514706 None] Lock "cinder-quobyte-a6ec7d78-44a1-4a23-b81f-bce4e3de025a" released by "delete_snapshot" :: held 3.338s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:26:14 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-3c90446a-c16e-4232-9f27-ab7f10cf94e4 tempest-SnapshotDependencyTests-1002514706 None] Created reservations ['929791d3-8183-41a5-8e21-b48a29c796b0', '034b80e8-2e36-4608-88da-34f0ac71553f', '6ffa1e0e-bc95-4d5a-b503-7f0339eacf78', '235b85a3-34ea-4d06-84db-59e377ada1fc'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:26:14 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-3c90446a-c16e-4232-9f27-ab7f10cf94e4 tempest-SnapshotDependencyTests-1002514706 None] Delete snapshot completed successfully. Jun 29 11:26:14 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3c90446a-c16e-4232-9f27-ab7f10cf94e4 tempest-SnapshotDependencyTests-1002514706 None] Lock "cinder-e4c8ba5c-8c8b-4f8f-a4ba-85efe7974033-delete_snapshot" released by "delete_snapshot" :: held 3.489s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:26:15 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-959ed709-49df-4f12-8b51-edc5a33fb98b tempest-SnapshotDependencyTests-1002514706 None] Acquiring lock "cinder-a6ec7d78-44a1-4a23-b81f-bce4e3de025a-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:26:15 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-959ed709-49df-4f12-8b51-edc5a33fb98b tempest-SnapshotDependencyTests-1002514706 None] Lock "cinder-a6ec7d78-44a1-4a23-b81f-bce4e3de025a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:26:15 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-959ed709-49df-4f12-8b51-edc5a33fb98b tempest-SnapshotDependencyTests-1002514706 None] Acquiring lock "cinder-quobyte-a6ec7d78-44a1-4a23-b81f-bce4e3de025a" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:26:15 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-959ed709-49df-4f12-8b51-edc5a33fb98b tempest-SnapshotDependencyTests-1002514706 None] Lock "cinder-quobyte-a6ec7d78-44a1-4a23-b81f-bce4e3de025a" acquired by "delete_volume" :: waited 0.016s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:26:15 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac407cd-0037-46dd-9f3b-d6a13a2f4c0c]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:26:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-959ed709-49df-4f12-8b51-edc5a33fb98b tempest-SnapshotDependencyTests-1002514706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:15 devstack sudo[113447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a Jun 29 11:26:15 devstack sudo[113447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:16 devstack sudo[113447]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-959ed709-49df-4f12-8b51-edc5a33fb98b tempest-SnapshotDependencyTests-1002514706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a" returned: 0 in 0.814s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-959ed709-49df-4f12-8b51-edc5a33fb98b tempest-SnapshotDependencyTests-1002514706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:16 devstack sudo[113453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a Jun 29 11:26:16 devstack sudo[113453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:17 devstack sudo[113453]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-959ed709-49df-4f12-8b51-edc5a33fb98b tempest-SnapshotDependencyTests-1002514706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a6ec7d78-44a1-4a23-b81f-bce4e3de025a" returned: 0 in 0.768s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:17 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-959ed709-49df-4f12-8b51-edc5a33fb98b tempest-SnapshotDependencyTests-1002514706 None] Lock "cinder-quobyte-a6ec7d78-44a1-4a23-b81f-bce4e3de025a" released by "delete_volume" :: held 1.663s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:26:17 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-959ed709-49df-4f12-8b51-edc5a33fb98b tempest-SnapshotDependencyTests-1002514706 None] Created reservations ['b8434bdb-5baf-4f24-b099-3b1d3e5f1d41', 'be1dd16d-468f-449b-a5ce-9b1ea58bafe1', '85abfbaa-90e3-42cb-b609-27980fa9da1c', '0bc4b3ae-7dcc-4aa6-adec-bdfd27c6b135'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:26:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-959ed709-49df-4f12-8b51-edc5a33fb98b tempest-SnapshotDependencyTests-1002514706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-959ed709-49df-4f12-8b51-edc5a33fb98b tempest-SnapshotDependencyTests-1002514706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-959ed709-49df-4f12-8b51-edc5a33fb98b tempest-SnapshotDependencyTests-1002514706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:26:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-959ed709-49df-4f12-8b51-edc5a33fb98b tempest-SnapshotDependencyTests-1002514706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:26:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-959ed709-49df-4f12-8b51-edc5a33fb98b tempest-SnapshotDependencyTests-1002514706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-959ed709-49df-4f12-8b51-edc5a33fb98b tempest-SnapshotDependencyTests-1002514706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:17 devstack sudo[113456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:26:17 devstack sudo[113456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:17 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ef5e3f00-07f1-4345-9c4b-2b40df1084ce tempest-SnapshotDependencyTests-1002514706 None] Acquiring lock "cinder-8533fe39-ccd0-4e98-a13d-43873452e72b-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:26:17 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ef5e3f00-07f1-4345-9c4b-2b40df1084ce tempest-SnapshotDependencyTests-1002514706 None] Lock "cinder-8533fe39-ccd0-4e98-a13d-43873452e72b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:26:17 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ef5e3f00-07f1-4345-9c4b-2b40df1084ce tempest-SnapshotDependencyTests-1002514706 None] Acquiring lock "cinder-quobyte-8533fe39-ccd0-4e98-a13d-43873452e72b" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:26:17 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ef5e3f00-07f1-4345-9c4b-2b40df1084ce tempest-SnapshotDependencyTests-1002514706 None] Lock "cinder-quobyte-8533fe39-ccd0-4e98-a13d-43873452e72b" acquired by "delete_volume" :: waited 0.048s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:26:17 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef33bef-4693-4088-8f3f-40038ce7b302]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:26:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ef5e3f00-07f1-4345-9c4b-2b40df1084ce tempest-SnapshotDependencyTests-1002514706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8533fe39-ccd0-4e98-a13d-43873452e72b {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:17 devstack sudo[113460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8533fe39-ccd0-4e98-a13d-43873452e72b Jun 29 11:26:17 devstack sudo[113460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:17 devstack sudo[113456]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-959ed709-49df-4f12-8b51-edc5a33fb98b tempest-SnapshotDependencyTests-1002514706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.732s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:17 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-959ed709-49df-4f12-8b51-edc5a33fb98b tempest-SnapshotDependencyTests-1002514706 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:26:17 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-959ed709-49df-4f12-8b51-edc5a33fb98b tempest-SnapshotDependencyTests-1002514706 None] Deleted volume successfully. Jun 29 11:26:17 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-959ed709-49df-4f12-8b51-edc5a33fb98b tempest-SnapshotDependencyTests-1002514706 None] Lock "cinder-a6ec7d78-44a1-4a23-b81f-bce4e3de025a-delete_volume" released by "delete_volume" :: held 2.622s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:26:18 devstack sudo[113460]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ef5e3f00-07f1-4345-9c4b-2b40df1084ce tempest-SnapshotDependencyTests-1002514706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8533fe39-ccd0-4e98-a13d-43873452e72b" returned: 0 in 0.828s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ef5e3f00-07f1-4345-9c4b-2b40df1084ce tempest-SnapshotDependencyTests-1002514706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8533fe39-ccd0-4e98-a13d-43873452e72b {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:18 devstack sudo[113469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8533fe39-ccd0-4e98-a13d-43873452e72b Jun 29 11:26:18 devstack sudo[113469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:19 devstack sudo[113469]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ef5e3f00-07f1-4345-9c4b-2b40df1084ce tempest-SnapshotDependencyTests-1002514706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-8533fe39-ccd0-4e98-a13d-43873452e72b" returned: 0 in 0.715s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:19 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ef5e3f00-07f1-4345-9c4b-2b40df1084ce tempest-SnapshotDependencyTests-1002514706 None] Lock "cinder-quobyte-8533fe39-ccd0-4e98-a13d-43873452e72b" released by "delete_volume" :: held 1.609s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:26:19 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-ef5e3f00-07f1-4345-9c4b-2b40df1084ce tempest-SnapshotDependencyTests-1002514706 None] Created reservations ['410e608f-0ba4-4bf5-81c8-d0d573bd6104', '132e63a8-4889-41f9-942d-59b1e1a9c5ac', '59434885-3007-435f-a650-c761670f9ee2', '747918f5-a8e0-4459-b7d3-e60fa0735766'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:26:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ef5e3f00-07f1-4345-9c4b-2b40df1084ce tempest-SnapshotDependencyTests-1002514706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ef5e3f00-07f1-4345-9c4b-2b40df1084ce tempest-SnapshotDependencyTests-1002514706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:19 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ef5e3f00-07f1-4345-9c4b-2b40df1084ce tempest-SnapshotDependencyTests-1002514706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:26:19 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ef5e3f00-07f1-4345-9c4b-2b40df1084ce tempest-SnapshotDependencyTests-1002514706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:26:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ef5e3f00-07f1-4345-9c4b-2b40df1084ce tempest-SnapshotDependencyTests-1002514706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ef5e3f00-07f1-4345-9c4b-2b40df1084ce tempest-SnapshotDependencyTests-1002514706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:19 devstack sudo[113475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:26:19 devstack sudo[113475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:20 devstack sudo[113475]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ef5e3f00-07f1-4345-9c4b-2b40df1084ce tempest-SnapshotDependencyTests-1002514706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.697s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:20 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-ef5e3f00-07f1-4345-9c4b-2b40df1084ce tempest-SnapshotDependencyTests-1002514706 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:26:20 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-ef5e3f00-07f1-4345-9c4b-2b40df1084ce tempest-SnapshotDependencyTests-1002514706 None] Deleted volume successfully. Jun 29 11:26:20 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-ef5e3f00-07f1-4345-9c4b-2b40df1084ce tempest-SnapshotDependencyTests-1002514706 None] Lock "cinder-8533fe39-ccd0-4e98-a13d-43873452e72b-delete_volume" released by "delete_volume" :: held 2.562s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:26:29 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=42,cinder:UPDATE=43,cinder:INSERT=14,cinder:DELETE=3 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:26:30 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=48,cinder:UPDATE=59,cinder:INSERT=12,cinder:DELETE=4 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:26:38 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:26:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] Flow 'volume_create_manager' (0123909e-730a-40c2-9069-302a3e2752e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:26:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53cb3d04-b2f6-4bba-8cb8-bda2e3d52d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53cb3d04-b2f6-4bba-8cb8-bda2e3d52d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-422013718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0814562b-e012-4191-9ef1-71cbc50a2425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32905572dd3478bbddb9bbddac7bd2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:26:39Z,use_quota=True,user_id='88c0de57bad14ca4814f48e80b35e70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a71d08-8de5-4b5a-bc2b-88b1357cde98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a71d08-8de5-4b5a-bc2b-88b1357cde98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d86c78-bf5b-4d36-83d5-ab8bc68b62b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d86c78-bf5b-4d36-83d5-ab8bc68b62b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0814562b-e012-4191-9ef1-71cbc50a2425', 'volume_name': 'volume-0814562b-e012-4191-9ef1-71cbc50a2425', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75885fe8-f716-43b3-ac77-0702db291729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75885fe8-f716-43b3-ac77-0702db291729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d2d447-e615-4d26-804b-ddc12bef7373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:39 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] Volume 0814562b-e012-4191-9ef1-71cbc50a2425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0814562b-e012-4191-9ef1-71cbc50a2425', 'volume_size': 1} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-422013718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0814562b-e012-4191-9ef1-71cbc50a2425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32905572dd3478bbddb9bbddac7bd2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:26:39Z,use_quota=True,user_id='88c0de57bad14ca4814f48e80b35e70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] Creating volume 0814562b-e012-4191-9ef1-71cbc50a2425 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:26:39 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0814562b-e012-4191-9ef1-71cbc50a2425 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:39 devstack sudo[113523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0814562b-e012-4191-9ef1-71cbc50a2425 1073741824 Jun 29 11:26:39 devstack sudo[113523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Flow 'volume_create_manager' (34966fc3-d558-4009-bbe0-267d20d66725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961cb74f-7d40-4dd1-810b-1697db079d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961cb74f-7d40-4dd1-810b-1697db079d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-286991456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d568413-2ee4-4459-9877-8416a480e8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5eb9a0b32e452c82f2aca626ce7eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:26:39Z,use_quota=True,user_id='f6235cca7de14311993c0a5a6aa87b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e1a4d1-e7a5-4005-9f70-e9461d566767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e1a4d1-e7a5-4005-9f70-e9461d566767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b84f3708-82fb-4d31-9627-2036cd3ef74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b84f3708-82fb-4d31-9627-2036cd3ef74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d568413-2ee4-4459-9877-8416a480e8f1', 'volume_name': 'volume-5d568413-2ee4-4459-9877-8416a480e8f1', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a52bbcb5-abab-475f-ae8e-a61b153322a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a52bbcb5-abab-475f-ae8e-a61b153322a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03220f9e-e9ab-4817-af57-a57b095bd237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:39 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Volume 5d568413-2ee4-4459-9877-8416a480e8f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d568413-2ee4-4459-9877-8416a480e8f1', 'volume_size': 1} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] Flow 'volume_create_manager' (cc7db471-50ae-48a7-9761-cab03e6ee177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9b10c9-58ea-42fc-9ebb-a768f156b615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9b10c9-58ea-42fc-9ebb-a768f156b615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2123880918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620940a7-d6b0-4a43-b574-63e865e70d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32905572dd3478bbddb9bbddac7bd2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:26:39Z,use_quota=True,user_id='88c0de57bad14ca4814f48e80b35e70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cf464e9-d06c-4504-a4a5-716788e7c88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cf464e9-d06c-4504-a4a5-716788e7c88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd7f20f1-ace2-41eb-972e-61d331712306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd7f20f1-ace2-41eb-972e-61d331712306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '620940a7-d6b0-4a43-b574-63e865e70d73', 'volume_name': 'volume-620940a7-d6b0-4a43-b574-63e865e70d73', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9d0631-db02-4867-b91a-bc64abc0273b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9d0631-db02-4867-b91a-bc64abc0273b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e94ced-f63a-49e9-a44c-e84e733b91ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:39 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] Volume 620940a7-d6b0-4a43-b574-63e865e70d73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-620940a7-d6b0-4a43-b574-63e865e70d73', 'volume_size': 1} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] Flow 'volume_create_manager' (0281a2cf-c70b-49b8-afd6-1e8015c61023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:26:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70738484-a0af-4e19-91d7-a9ecfb2782f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70738484-a0af-4e19-91d7-a9ecfb2782f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1855706514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f7bdf0-2808-4502-8894-93725b28b0b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32905572dd3478bbddb9bbddac7bd2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:26:40Z,use_quota=True,user_id='88c0de57bad14ca4814f48e80b35e70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06754794-1806-4f06-8374-2eac56c3a57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06754794-1806-4f06-8374-2eac56c3a57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5210878-4202-4282-9b7f-240e4a64e8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5210878-4202-4282-9b7f-240e4a64e8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2f7bdf0-2808-4502-8894-93725b28b0b7', 'volume_name': 'volume-f2f7bdf0-2808-4502-8894-93725b28b0b7', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d2e0d5-5a5d-4a31-bf13-61ce9f571cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d2e0d5-5a5d-4a31-bf13-61ce9f571cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d1e2be-7407-48a2-825d-fa50da89dc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:40 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] Volume f2f7bdf0-2808-4502-8894-93725b28b0b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2f7bdf0-2808-4502-8894-93725b28b0b7', 'volume_size': 1} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] Flow 'volume_create_manager' (dbc269a7-d537-4386-8483-55d032df9e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48be984c-d097-4dd9-b266-96339109acf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48be984c-d097-4dd9-b266-96339109acf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-582466689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93597b3e-0cda-4fa4-8261-d7b834309482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32905572dd3478bbddb9bbddac7bd2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:26:40Z,use_quota=True,user_id='88c0de57bad14ca4814f48e80b35e70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95657e7-7ecb-46c7-ae7c-8a71ea43df58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:40 devstack sudo[113523]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95657e7-7ecb-46c7-ae7c-8a71ea43df58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c6cb55-1375-4c46-8da8-42e97425704c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c6cb55-1375-4c46-8da8-42e97425704c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93597b3e-0cda-4fa4-8261-d7b834309482', 'volume_name': 'volume-93597b3e-0cda-4fa4-8261-d7b834309482', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a523e2d-d674-46c6-a453-5ba425f3c14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a523e2d-d674-46c6-a453-5ba425f3c14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf1163e9-8691-46ba-9b80-32b9d60aaeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:40 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] Volume 93597b3e-0cda-4fa4-8261-d7b834309482: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93597b3e-0cda-4fa4-8261-d7b834309482', 'volume_size': 1} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0814562b-e012-4191-9ef1-71cbc50a2425 1073741824" returned: 0 in 1.372s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0814562b-e012-4191-9ef1-71cbc50a2425 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:40 devstack sudo[113529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0814562b-e012-4191-9ef1-71cbc50a2425 Jun 29 11:26:40 devstack sudo[113529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] Flow 'volume_create_manager' (7b048c71-aaeb-4a59-9b3a-c977d19ef8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a69cf1-1f19-4297-8fa2-3238bd2752b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a69cf1-1f19-4297-8fa2-3238bd2752b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-998807973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463db27c-0cf2-4d69-9105-93769f13fb97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32905572dd3478bbddb9bbddac7bd2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:26:41Z,use_quota=True,user_id='88c0de57bad14ca4814f48e80b35e70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49bfd931-ba58-49b1-82ef-6321dbfa4cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49bfd931-ba58-49b1-82ef-6321dbfa4cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97469bd2-3a79-43ff-99f6-f6715335cf7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97469bd2-3a79-43ff-99f6-f6715335cf7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '463db27c-0cf2-4d69-9105-93769f13fb97', 'volume_name': 'volume-463db27c-0cf2-4d69-9105-93769f13fb97', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a679d314-1f7a-48f6-a784-7cbc2d82c9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a679d314-1f7a-48f6-a784-7cbc2d82c9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74f61a6e-ae33-4477-b0b0-6e92c830a28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:40 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] Volume 463db27c-0cf2-4d69-9105-93769f13fb97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-463db27c-0cf2-4d69-9105-93769f13fb97', 'volume_size': 1} Jun 29 11:26:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:41 devstack sudo[113529]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0814562b-e012-4191-9ef1-71cbc50a2425" returned: 0 in 0.750s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:41 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] <== create_volume: return (2182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:26:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.185s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.991s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:41 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-286991456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d568413-2ee4-4459-9877-8416a480e8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5eb9a0b32e452c82f2aca626ce7eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:26:39Z,use_quota=True,user_id='f6235cca7de14311993c0a5a6aa87b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:26:41 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Creating volume 5d568413-2ee4-4459-9877-8416a480e8f1 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:26:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:41 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:26:41 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:26:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:41 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:26:41 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:26:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5d568413-2ee4-4459-9877-8416a480e8f1 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:41 devstack sudo[113532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5d568413-2ee4-4459-9877-8416a480e8f1 1073741824 Jun 29 11:26:41 devstack sudo[113532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d2d447-e615-4d26-804b-ddc12bef7373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0814562b-e012-4191-9ef1-71cbc50a2425', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db1ad9d8-2e7b-463f-a46b-307b9f1860c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:41 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] Volume volume-0814562b-e012-4191-9ef1-71cbc50a2425 (0814562b-e012-4191-9ef1-71cbc50a2425): created successfully Jun 29 11:26:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db1ad9d8-2e7b-463f-a46b-307b9f1860c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:41 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] Flow 'volume_create_manager' (0123909e-730a-40c2-9069-302a3e2752e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:26:41 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-1d040afb-9c41-447d-897f-8c1d0e5d4f96 tempest-CreateVolumesFromImageTest-987683421 None] Created volume successfully. Jun 29 11:26:42 devstack sudo[113532]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5d568413-2ee4-4459-9877-8416a480e8f1 1073741824" returned: 0 in 1.009s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5d568413-2ee4-4459-9877-8416a480e8f1 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:26:42 devstack sudo[113538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5d568413-2ee4-4459-9877-8416a480e8f1 Jun 29 11:26:42 devstack sudo[113538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Flow 'volume_create_manager' (b8febdd4-2984-49ec-a528-2035fdb9a08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae9a040b-9e38-46a3-b19c-5c2ef508586d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae9a040b-9e38-46a3-b19c-5c2ef508586d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f7a97e0-c685-409c-9d3a-40dbdbb6fd13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04364cda717644b797a7a0bec8ca3e3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:26:42Z,use_quota=True,user_id='0187fad7449f4846a369cd82c8bcad6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18e23ae3-4c58-49c2-a1a7-6ae1426b7f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18e23ae3-4c58-49c2-a1a7-6ae1426b7f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b53e120e-088f-4def-91d6-67d5c8547345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG cinder.image.glance [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Creating Keystone auth plugin from conf {{(pid=93497) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b53e120e-088f-4def-91d6-67d5c8547345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4f7a97e0-c685-409c-9d3a-40dbdbb6fd13', 'volume_name': 'volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13', 'volume_size': 1, 'image_id': 'cf24f77f-467a-45d9-a408-9464f5c269d2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf24f77f-467a-45d9-a408-9464f5c269d2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '72dd931807c158bc47a891a82cb8d00c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '04364cda717644b797a7a0bec8ca3e3f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0735a162855b01a9675b68210183d4364a91550ec5e8378ee123010579ab0e21f937370d85ba7a4ef48a87e359f34b2ea3060a02080d1092e0b67dc5412b9bc9', 'id': 'cf24f77f-467a-45d9-a408-9464f5c269d2', 'created_at': datetime.datetime(2026, 6, 29, 9, 26, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 9, 26, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf24f77f-467a-45d9-a408-9464f5c269d2/file', 'properties': {}}, 'image_service': }' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9906f01f-4853-4cd5-bd98-0a69965402db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9906f01f-4853-4cd5-bd98-0a69965402db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6586a9d-639c-4c5d-bf3a-213cc1c3a72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:42 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Volume 4f7a97e0-c685-409c-9d3a-40dbdbb6fd13: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13', 'volume_size': 1, 'image_id': 'cf24f77f-467a-45d9-a408-9464f5c269d2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf24f77f-467a-45d9-a408-9464f5c269d2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '72dd931807c158bc47a891a82cb8d00c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '04364cda717644b797a7a0bec8ca3e3f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0735a162855b01a9675b68210183d4364a91550ec5e8378ee123010579ab0e21f937370d85ba7a4ef48a87e359f34b2ea3060a02080d1092e0b67dc5412b9bc9', 'id': 'cf24f77f-467a-45d9-a408-9464f5c269d2', 'created_at': datetime.datetime(2026, 6, 29, 9, 26, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 9, 26, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf24f77f-467a-45d9-a408-9464f5c269d2/file', 'properties': {}}, 'image_service': } Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Trying to clone 4f7a97e0-c685-409c-9d3a-40dbdbb6fd13 from image cf24f77f-467a-45d9-a408-9464f5c269d2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cf24f77f-467a-45d9-a408-9464f5c269d2', 'metadata': {}}]). {{(pid=93497) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cf24f77f-467a-45d9-a408-9464f5c269d2_953_i15adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93497) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 29 11:26:42 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Image download 0.00 MB at 0.00 MB/s Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9f856c-7641-491c-8899-c99eca81d5f8]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf24f77f-467a-45d9-a408-9464f5c269d2_953_i15adevstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:42 devstack sudo[113540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf24f77f-467a-45d9-a408-9464f5c269d2_953_i15adevstack@QuobyteHD Jun 29 11:26:42 devstack sudo[113540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:42 devstack sudo[113538]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5d568413-2ee4-4459-9877-8416a480e8f1" returned: 0 in 0.700s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.385s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2123880918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=620940a7-d6b0-4a43-b574-63e865e70d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32905572dd3478bbddb9bbddac7bd2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:26:39Z,use_quota=True,user_id='88c0de57bad14ca4814f48e80b35e70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] Creating volume 620940a7-d6b0-4a43-b574-63e865e70d73 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:26:42 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:26:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-620940a7-d6b0-4a43-b574-63e865e70d73 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03220f9e-e9ab-4817-af57-a57b095bd237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d568413-2ee4-4459-9877-8416a480e8f1', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:43 devstack sudo[113543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-620940a7-d6b0-4a43-b574-63e865e70d73 1073741824 Jun 29 11:26:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c2e2621-bd5c-42e5-8b1f-f99e3edca7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:43 devstack sudo[113543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:43 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Volume volume-5d568413-2ee4-4459-9877-8416a480e8f1 (5d568413-2ee4-4459-9877-8416a480e8f1): created successfully Jun 29 11:26:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c2e2621-bd5c-42e5-8b1f-f99e3edca7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Flow 'volume_create_manager' (34966fc3-d558-4009-bbe0-267d20d66725) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:26:43 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-0da752ad-cba8-4f53-864d-e07f4b5e8a73 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Created volume successfully. Jun 29 11:26:43 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:26:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Flow 'volume_create_manager' (d70902af-809f-4599-ad3b-fd32e3e2c8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:26:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6a3e26-d360-4d06-90b6-df08e937629c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d6a3e26-d360-4d06-90b6-df08e937629c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57d8bc61e5784a689d548c0f71262ef9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:26:43Z,use_quota=True,user_id='6d3bb171e2c744369a8ca54ee1aa1cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df96f11e-1cdf-4e9a-bbd8-643b1ba27ae2),volume_type_id=df96f11e-1cdf-4e9a-bbd8-643b1ba27ae2)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77bd65e-c232-4c72-bedb-e825ec1dedea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77bd65e-c232-4c72-bedb-e825ec1dedea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a308eb-ba80-445c-810a-305939247bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:43 devstack cinder-volume[93497]: DEBUG cinder.image.glance [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Creating Keystone auth plugin from conf {{(pid=93497) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 29 11:26:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a308eb-ba80-445c-810a-305939247bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04', 'volume_name': 'volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04', 'volume_size': 1, 'image_id': 'c2f56963-c5ec-47f4-a61b-d219dfee2fa7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c2f56963-c5ec-47f4-a61b-d219dfee2fa7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '16c592d17c52ae7eb14b6902baffe9ce', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '57d8bc61e5784a689d548c0f71262ef9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4fd1a3c402cf5374ecce2990056b6d41e9472cf2d0e6220911867c87496dce14cacc14297be1a286475e08a753177faeef7fcf58856535d017143978cd50497b', 'id': 'c2f56963-c5ec-47f4-a61b-d219dfee2fa7', 'created_at': datetime.datetime(2026, 6, 29, 9, 26, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 9, 26, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c2f56963-c5ec-47f4-a61b-d219dfee2fa7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d0dcee-cb19-4ca3-9db3-bab8ed198ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d0dcee-cb19-4ca3-9db3-bab8ed198ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:43 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba51e346-c8c4-4d29-b035-25ac2be58448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:43 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Volume ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04', 'volume_size': 1, 'image_id': 'c2f56963-c5ec-47f4-a61b-d219dfee2fa7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c2f56963-c5ec-47f4-a61b-d219dfee2fa7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '16c592d17c52ae7eb14b6902baffe9ce', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '57d8bc61e5784a689d548c0f71262ef9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4fd1a3c402cf5374ecce2990056b6d41e9472cf2d0e6220911867c87496dce14cacc14297be1a286475e08a753177faeef7fcf58856535d017143978cd50497b', 'id': 'c2f56963-c5ec-47f4-a61b-d219dfee2fa7', 'created_at': datetime.datetime(2026, 6, 29, 9, 26, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 9, 26, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c2f56963-c5ec-47f4-a61b-d219dfee2fa7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 29 11:26:43 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Trying to clone ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04 from image c2f56963-c5ec-47f4-a61b-d219dfee2fa7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c2f56963-c5ec-47f4-a61b-d219dfee2fa7', 'metadata': {}}]). {{(pid=93497) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 29 11:26:43 devstack sudo[113540]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf24f77f-467a-45d9-a408-9464f5c269d2_953_i15adevstack@QuobyteHD" returned: 0 in 0.955s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf24f77f-467a-45d9-a408-9464f5c269d2_953_i15adevstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:43 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_6n4u3vkpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93497) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 29 11:26:43 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Image download 0.00 MB at 0.00 MB/s Jun 29 11:26:43 devstack sudo[113547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf24f77f-467a-45d9-a408-9464f5c269d2_953_i15adevstack@QuobyteHD Jun 29 11:26:43 devstack sudo[113547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:43 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b65e4b2-42b1-4b75-b30c-01b756c59da4]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:26:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_6n4u3vkpdevstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:44 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:26:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Flow 'volume_create_manager' (49609e04-a14b-43c5-bf41-2c8d0e314ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:26:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b691fc40-964f-4da4-8d02-f5e6f8e6e9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b691fc40-964f-4da4-8d02-f5e6f8e6e9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-666820511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9213451-2db1-4d48-93d9-05a5cd1bc9ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5eb9a0b32e452c82f2aca626ce7eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:26:44Z,use_quota=True,user_id='f6235cca7de14311993c0a5a6aa87b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894f784b-81f2-4831-be8e-40eab8fda92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894f784b-81f2-4831-be8e-40eab8fda92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fd4a4a0-535e-40a3-a014-b25d0d327868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fd4a4a0-535e-40a3-a014-b25d0d327868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9213451-2db1-4d48-93d9-05a5cd1bc9ed', 'volume_name': 'volume-f9213451-2db1-4d48-93d9-05a5cd1bc9ed', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451d6909-f272-4655-8ec1-cb4aba6a5102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451d6909-f272-4655-8ec1-cb4aba6a5102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a474806e-eae0-4bfc-b220-7437bb1a00c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:44 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Volume f9213451-2db1-4d48-93d9-05a5cd1bc9ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9213451-2db1-4d48-93d9-05a5cd1bc9ed', 'volume_size': 1} Jun 29 11:26:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:44 devstack sudo[113553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_6n4u3vkpdevstack@QuobyteHD Jun 29 11:26:44 devstack sudo[113553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:44 devstack sudo[113543]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-620940a7-d6b0-4a43-b574-63e865e70d73 1073741824" returned: 0 in 1.293s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-620940a7-d6b0-4a43-b574-63e865e70d73 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:44 devstack sudo[113555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-620940a7-d6b0-4a43-b574-63e865e70d73 Jun 29 11:26:44 devstack sudo[113555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:44 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:26:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Flow 'volume_create_manager' (3c11ab5a-e8e8-4c07-ab96-e95a2c4cf4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:26:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22da83f4-bcfa-4efe-b450-a9b98022ba80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22da83f4-bcfa-4efe-b450-a9b98022ba80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1483143963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b7885b-b04e-4258-a59e-59c963182d11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5eb9a0b32e452c82f2aca626ce7eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:26:45Z,use_quota=True,user_id='f6235cca7de14311993c0a5a6aa87b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25919f36-cdf3-43bb-9c85-1c77e829b901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25919f36-cdf3-43bb-9c85-1c77e829b901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46a33744-57d9-49da-bc75-9465cedaf895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46a33744-57d9-49da-bc75-9465cedaf895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17b7885b-b04e-4258-a59e-59c963182d11', 'volume_name': 'volume-17b7885b-b04e-4258-a59e-59c963182d11', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f83bcb6d-671c-44df-b529-be77b2171825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f83bcb6d-671c-44df-b529-be77b2171825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92460260-3f44-446f-b9c4-30feb515adff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:44 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Volume 17b7885b-b04e-4258-a59e-59c963182d11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17b7885b-b04e-4258-a59e-59c963182d11', 'volume_size': 1} Jun 29 11:26:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:44 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:26:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Flow 'volume_create_manager' (3222bd96-60a9-4fa6-854c-0b8e86ab1e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:26:44 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b240211-b8f5-4ff8-8e28-a4d447df6422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:45 devstack sudo[113547]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b240211-b8f5-4ff8-8e28-a4d447df6422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1436778501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a93f4d17-0eb9-4f4e-95d4-8e414d93942f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5eb9a0b32e452c82f2aca626ce7eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:26:45Z,use_quota=True,user_id='f6235cca7de14311993c0a5a6aa87b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d51ffbb-10bc-42a3-9b6e-0723f2881bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d51ffbb-10bc-42a3-9b6e-0723f2881bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c022aae9-ad6e-44fc-818a-977b5ed4e2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c022aae9-ad6e-44fc-818a-977b5ed4e2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a93f4d17-0eb9-4f4e-95d4-8e414d93942f', 'volume_name': 'volume-a93f4d17-0eb9-4f4e-95d4-8e414d93942f', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8676d6e1-c911-43cb-8b57-a41447e001ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8676d6e1-c911-43cb-8b57-a41447e001ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bba28767-b4ed-41e9-b144-495d7ff8ce2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:45 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Volume a93f4d17-0eb9-4f4e-95d4-8e414d93942f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a93f4d17-0eb9-4f4e-95d4-8e414d93942f', 'volume_size': 1} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf24f77f-467a-45d9-a408-9464f5c269d2_953_i15adevstack@QuobyteHD" returned: 1 in 1.371s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf24f77f-467a-45d9-a408-9464f5c269d2_953_i15adevstack@QuobyteHD' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Temporary image cf24f77f-467a-45d9-a408-9464f5c269d2 is fetched for user 0187fad7449f4846a369cd82c8bcad6a. {{(pid=93497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 29 11:26:45 devstack sudo[113553]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_6n4u3vkpdevstack@QuobyteHD" returned: 0 in 1.183s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_6n4u3vkpdevstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:45 devstack sudo[113555]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-620940a7-d6b0-4a43-b574-63e865e70d73" returned: 0 in 0.864s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] <== create_volume: return (2231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.234s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.107s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1855706514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f7bdf0-2808-4502-8894-93725b28b0b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32905572dd3478bbddb9bbddac7bd2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:26:40Z,use_quota=True,user_id='88c0de57bad14ca4814f48e80b35e70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] Creating volume f2f7bdf0-2808-4502-8894-93725b28b0b7 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:26:45 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f2f7bdf0-2808-4502-8894-93725b28b0b7 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8e94ced-f63a-49e9-a44c-e84e733b91ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-620940a7-d6b0-4a43-b574-63e865e70d73', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab8525c-9965-4d6f-9afc-926bab45f9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:45 devstack sudo[113565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f2f7bdf0-2808-4502-8894-93725b28b0b7 1073741824 Jun 29 11:26:45 devstack sudo[113565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:45 devstack sudo[113563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_6n4u3vkpdevstack@QuobyteHD Jun 29 11:26:45 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] Volume volume-620940a7-d6b0-4a43-b574-63e865e70d73 (620940a7-d6b0-4a43-b574-63e865e70d73): created successfully Jun 29 11:26:45 devstack sudo[113563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab8525c-9965-4d6f-9afc-926bab45f9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] Flow 'volume_create_manager' (cc7db471-50ae-48a7-9761-cab03e6ee177) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b95da9-1496-48ee-8ec6-6d31920e44e2]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf24f77f-467a-45d9-a408-9464f5c269d2_953_i15adevstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:45 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-ae9ddde0-a8fa-422a-a7e9-27b1074d63ba tempest-CreateVolumesFromImageTest-987683421 None] Created volume successfully. Jun 29 11:26:45 devstack sudo[113568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf24f77f-467a-45d9-a408-9464f5c269d2_953_i15adevstack@QuobyteHD Jun 29 11:26:45 devstack sudo[113568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Flow 'volume_create_manager' (830ff81e-872c-40dd-8e9e-ef9429217889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ab3eb7-b140-46c5-be53-bb2738ea9892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ab3eb7-b140-46c5-be53-bb2738ea9892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2095132468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3353759-7e00-4a9d-bbcf-e9fd2a436fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5eb9a0b32e452c82f2aca626ce7eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:26:45Z,use_quota=True,user_id='f6235cca7de14311993c0a5a6aa87b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (586b26a7-e057-45fe-a60d-9446fba1856b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (586b26a7-e057-45fe-a60d-9446fba1856b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605f8c79-5034-4dcd-8c3b-69eb3c4ffb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605f8c79-5034-4dcd-8c3b-69eb3c4ffb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3353759-7e00-4a9d-bbcf-e9fd2a436fb5', 'volume_name': 'volume-c3353759-7e00-4a9d-bbcf-e9fd2a436fb5', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58850c0f-9097-4e49-bcc5-349f981b3a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58850c0f-9097-4e49-bcc5-349f981b3a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7910c358-c62c-460e-8488-5c17a4213d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:45 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Volume c3353759-7e00-4a9d-bbcf-e9fd2a436fb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3353759-7e00-4a9d-bbcf-e9fd2a436fb5', 'volume_size': 1} Jun 29 11:26:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:46 devstack sudo[113563]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_6n4u3vkpdevstack@QuobyteHD" returned: 1 in 0.880s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_6n4u3vkpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:26:46 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Temporary image c2f56963-c5ec-47f4-a61b-d219dfee2fa7 is fetched for user 6d3bb171e2c744369a8ca54ee1aa1cd6. {{(pid=93497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 29 11:26:46 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:26:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Flow 'volume_create_manager' (0d1450c8-6cd4-4220-a8ee-2505d4a2a2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:26:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d23415-129c-4cfe-bcce-ad247af6c19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d23415-129c-4cfe-bcce-ad247af6c19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1029757047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b994dd-07d6-4d6c-928b-49bd2a6d3948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5eb9a0b32e452c82f2aca626ce7eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:26:46Z,use_quota=True,user_id='f6235cca7de14311993c0a5a6aa87b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a658c1a-055f-45c5-9363-70ea52c4df96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a658c1a-055f-45c5-9363-70ea52c4df96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fdcfed-5c90-495c-b629-9ca598fb9292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fdcfed-5c90-495c-b629-9ca598fb9292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24b994dd-07d6-4d6c-928b-49bd2a6d3948', 'volume_name': 'volume-24b994dd-07d6-4d6c-928b-49bd2a6d3948', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d0a3dc8-cf92-437a-8e40-57ba98faac17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d0a3dc8-cf92-437a-8e40-57ba98faac17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d9883a-8888-41ae-b980-6db7bd13b2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:46 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Volume 24b994dd-07d6-4d6c-928b-49bd2a6d3948: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24b994dd-07d6-4d6c-928b-49bd2a6d3948', 'volume_size': 1} Jun 29 11:26:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:46 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d5f395-ca02-41c0-9ef6-b26f6da725e1]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:26:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_6n4u3vkpdevstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:46 devstack sudo[113568]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf24f77f-467a-45d9-a408-9464f5c269d2_953_i15adevstack@QuobyteHD" returned: 0 in 0.902s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf24f77f-467a-45d9-a408-9464f5c269d2_953_i15adevstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:46 devstack sudo[113578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_6n4u3vkpdevstack@QuobyteHD Jun 29 11:26:46 devstack sudo[113578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:46 devstack sudo[113580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf24f77f-467a-45d9-a408-9464f5c269d2_953_i15adevstack@QuobyteHD Jun 29 11:26:46 devstack sudo[113580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:46 devstack sudo[113565]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f2f7bdf0-2808-4502-8894-93725b28b0b7 1073741824" returned: 0 in 1.172s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f2f7bdf0-2808-4502-8894-93725b28b0b7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:46 devstack sudo[113583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f2f7bdf0-2808-4502-8894-93725b28b0b7 Jun 29 11:26:46 devstack sudo[113583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:46 devstack sudo[113578]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_6n4u3vkpdevstack@QuobyteHD" returned: 0 in 0.758s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_6n4u3vkpdevstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:46 devstack sudo[113580]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf24f77f-467a-45d9-a408-9464f5c269d2_953_i15adevstack@QuobyteHD" returned: 1 in 0.764s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf24f77f-467a-45d9-a408-9464f5c269d2_953_i15adevstack@QuobyteHD' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:26:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:47 devstack sudo[113590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_6n4u3vkpdevstack@QuobyteHD Jun 29 11:26:47 devstack sudo[113590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:47 devstack sudo[113583]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f2f7bdf0-2808-4502-8894-93725b28b0b7" returned: 0 in 0.678s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] <== create_volume: return (1907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:26:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.909s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.734s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-582466689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93597b3e-0cda-4fa4-8261-d7b834309482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32905572dd3478bbddb9bbddac7bd2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:26:40Z,use_quota=True,user_id='88c0de57bad14ca4814f48e80b35e70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:26:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] Creating volume 93597b3e-0cda-4fa4-8261-d7b834309482 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:26:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:26:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:26:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:26:47 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:26:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-93597b3e-0cda-4fa4-8261-d7b834309482 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d1e2be-7407-48a2-825d-fa50da89dc82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2f7bdf0-2808-4502-8894-93725b28b0b7', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:47 devstack sudo[113593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-93597b3e-0cda-4fa4-8261-d7b834309482 1073741824 Jun 29 11:26:47 devstack sudo[113593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e275e722-dd85-4063-812a-9e1a31b11720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:47 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] Volume volume-f2f7bdf0-2808-4502-8894-93725b28b0b7 (f2f7bdf0-2808-4502-8894-93725b28b0b7): created successfully Jun 29 11:26:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e275e722-dd85-4063-812a-9e1a31b11720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] Flow 'volume_create_manager' (0281a2cf-c70b-49b8-afd6-1e8015c61023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:26:47 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-eff722ce-1a5f-4692-88db-bcea90b5d762 tempest-CreateVolumesFromImageTest-987683421 None] Created volume successfully. Jun 29 11:26:47 devstack sudo[113590]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_6n4u3vkpdevstack@QuobyteHD" returned: 1 in 0.759s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_6n4u3vkpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:26:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:47 devstack sudo[113593]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-93597b3e-0cda-4fa4-8261-d7b834309482 1073741824" returned: 0 in 0.819s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-93597b3e-0cda-4fa4-8261-d7b834309482 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:48 devstack sudo[113605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-93597b3e-0cda-4fa4-8261-d7b834309482 Jun 29 11:26:48 devstack sudo[113605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:48 devstack sudo[113605]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-93597b3e-0cda-4fa4-8261-d7b834309482" returned: 0 in 0.659s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:48 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:26:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.899s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:48 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-998807973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463db27c-0cf2-4d69-9105-93769f13fb97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32905572dd3478bbddb9bbddac7bd2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:26:41Z,use_quota=True,user_id='88c0de57bad14ca4814f48e80b35e70e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:26:48 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] Creating volume 463db27c-0cf2-4d69-9105-93769f13fb97 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:26:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:48 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:26:48 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:26:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:48 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:26:48 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:26:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-463db27c-0cf2-4d69-9105-93769f13fb97 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:48 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf1163e9-8691-46ba-9b80-32b9d60aaeb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93597b3e-0cda-4fa4-8261-d7b834309482', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:48 devstack sudo[113608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-463db27c-0cf2-4d69-9105-93769f13fb97 1073741824 Jun 29 11:26:48 devstack sudo[113608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:48 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cbc163a-0df5-4d01-aec0-89728685d8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:48 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] Volume volume-93597b3e-0cda-4fa4-8261-d7b834309482 (93597b3e-0cda-4fa4-8261-d7b834309482): created successfully Jun 29 11:26:48 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cbc163a-0df5-4d01-aec0-89728685d8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:48 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] Flow 'volume_create_manager' (dbc269a7-d537-4386-8483-55d032df9e03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:26:48 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-0c7eb7cb-a2ba-4ae3-808a-8d40991c4cea tempest-CreateVolumesFromImageTest-987683421 None] Created volume successfully. Jun 29 11:26:49 devstack sudo[113608]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-463db27c-0cf2-4d69-9105-93769f13fb97 1073741824" returned: 0 in 0.818s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-463db27c-0cf2-4d69-9105-93769f13fb97 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:49 devstack sudo[113614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-463db27c-0cf2-4d69-9105-93769f13fb97 Jun 29 11:26:49 devstack sudo[113614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:50 devstack sudo[113614]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-463db27c-0cf2-4d69-9105-93769f13fb97" returned: 0 in 0.621s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:26:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.137s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-666820511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9213451-2db1-4d48-93d9-05a5cd1bc9ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5eb9a0b32e452c82f2aca626ce7eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:26:44Z,use_quota=True,user_id='f6235cca7de14311993c0a5a6aa87b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:26:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Creating volume f9213451-2db1-4d48-93d9-05a5cd1bc9ed {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:26:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:26:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:26:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:26:50 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:26:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f9213451-2db1-4d48-93d9-05a5cd1bc9ed 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74f61a6e-ae33-4477-b0b0-6e92c830a28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-463db27c-0cf2-4d69-9105-93769f13fb97', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:50 devstack sudo[113617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f9213451-2db1-4d48-93d9-05a5cd1bc9ed 1073741824 Jun 29 11:26:50 devstack sudo[113617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19b6dfbe-8223-40ab-80eb-af0ac228564b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:50 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] Volume volume-463db27c-0cf2-4d69-9105-93769f13fb97 (463db27c-0cf2-4d69-9105-93769f13fb97): created successfully Jun 29 11:26:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19b6dfbe-8223-40ab-80eb-af0ac228564b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] Flow 'volume_create_manager' (7b048c71-aaeb-4a59-9b3a-c977d19ef8ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:26:50 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-9d4b2c80-573e-4d45-adda-96fd4006bf96 tempest-CreateVolumesFromImageTest-987683421 None] Created volume successfully. Jun 29 11:26:50 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-11f151f5-c4a1-4d2e-a2d0-a746486ff8ad tempest-CreateVolumesFromImageTest-987683421 None] Acquiring lock "cinder-463db27c-0cf2-4d69-9105-93769f13fb97-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:26:50 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-11f151f5-c4a1-4d2e-a2d0-a746486ff8ad tempest-CreateVolumesFromImageTest-987683421 None] Lock "cinder-463db27c-0cf2-4d69-9105-93769f13fb97-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:26:50 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-11f151f5-c4a1-4d2e-a2d0-a746486ff8ad tempest-CreateVolumesFromImageTest-987683421 None] Acquiring lock "cinder-quobyte-463db27c-0cf2-4d69-9105-93769f13fb97" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:26:50 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-11f151f5-c4a1-4d2e-a2d0-a746486ff8ad tempest-CreateVolumesFromImageTest-987683421 None] Lock "cinder-quobyte-463db27c-0cf2-4d69-9105-93769f13fb97" acquired by "delete_volume" :: waited 0.017s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:26:50 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06d1c5f-bfd0-4ccc-8e47-fd3cc2aee94f]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:26:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-11f151f5-c4a1-4d2e-a2d0-a746486ff8ad tempest-CreateVolumesFromImageTest-987683421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-463db27c-0cf2-4d69-9105-93769f13fb97 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:50 devstack sudo[113619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-463db27c-0cf2-4d69-9105-93769f13fb97 Jun 29 11:26:50 devstack sudo[113619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:51 devstack sudo[113617]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f9213451-2db1-4d48-93d9-05a5cd1bc9ed 1073741824" returned: 0 in 0.793s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f9213451-2db1-4d48-93d9-05a5cd1bc9ed {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:51 devstack sudo[113625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f9213451-2db1-4d48-93d9-05a5cd1bc9ed Jun 29 11:26:51 devstack sudo[113625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:51 devstack sudo[113619]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-11f151f5-c4a1-4d2e-a2d0-a746486ff8ad tempest-CreateVolumesFromImageTest-987683421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-463db27c-0cf2-4d69-9105-93769f13fb97" returned: 0 in 0.745s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-11f151f5-c4a1-4d2e-a2d0-a746486ff8ad tempest-CreateVolumesFromImageTest-987683421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-463db27c-0cf2-4d69-9105-93769f13fb97 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:51 devstack sudo[113630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-463db27c-0cf2-4d69-9105-93769f13fb97 Jun 29 11:26:51 devstack sudo[113630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:51 devstack sudo[113625]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f9213451-2db1-4d48-93d9-05a5cd1bc9ed" returned: 0 in 0.634s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:26:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.965s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1483143963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b7885b-b04e-4258-a59e-59c963182d11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5eb9a0b32e452c82f2aca626ce7eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:26:45Z,use_quota=True,user_id='f6235cca7de14311993c0a5a6aa87b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:26:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Creating volume 17b7885b-b04e-4258-a59e-59c963182d11 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:26:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:26:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:26:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:26:51 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:26:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17b7885b-b04e-4258-a59e-59c963182d11 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:51 devstack sudo[113633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17b7885b-b04e-4258-a59e-59c963182d11 1073741824 Jun 29 11:26:51 devstack sudo[113633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a474806e-eae0-4bfc-b220-7437bb1a00c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9213451-2db1-4d48-93d9-05a5cd1bc9ed', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ac8471e-f531-4595-86d1-2dfeb777a51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:51 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Volume volume-f9213451-2db1-4d48-93d9-05a5cd1bc9ed (f9213451-2db1-4d48-93d9-05a5cd1bc9ed): created successfully Jun 29 11:26:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ac8471e-f531-4595-86d1-2dfeb777a51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Flow 'volume_create_manager' (49609e04-a14b-43c5-bf41-2c8d0e314ed0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:26:51 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-d292fd25-bc44-486c-a9b6-5797a0de5736 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Created volume successfully. Jun 29 11:26:52 devstack sudo[113630]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-11f151f5-c4a1-4d2e-a2d0-a746486ff8ad tempest-CreateVolumesFromImageTest-987683421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-463db27c-0cf2-4d69-9105-93769f13fb97" returned: 0 in 0.620s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:52 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-11f151f5-c4a1-4d2e-a2d0-a746486ff8ad tempest-CreateVolumesFromImageTest-987683421 None] Lock "cinder-quobyte-463db27c-0cf2-4d69-9105-93769f13fb97" released by "delete_volume" :: held 1.403s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:26:52 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-11f151f5-c4a1-4d2e-a2d0-a746486ff8ad tempest-CreateVolumesFromImageTest-987683421 None] Created reservations ['5d4a8f7c-5807-40d6-af89-3f3570df9472', '46e0d007-c4ed-48b7-82ec-44a4521313c6', '7fae1342-77db-4afa-897e-e17921d6f6b5', 'd80d25be-bb49-4091-a7c5-cd93b28e7170'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:26:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-11f151f5-c4a1-4d2e-a2d0-a746486ff8ad tempest-CreateVolumesFromImageTest-987683421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-11f151f5-c4a1-4d2e-a2d0-a746486ff8ad tempest-CreateVolumesFromImageTest-987683421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:52 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-11f151f5-c4a1-4d2e-a2d0-a746486ff8ad tempest-CreateVolumesFromImageTest-987683421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:26:52 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-11f151f5-c4a1-4d2e-a2d0-a746486ff8ad tempest-CreateVolumesFromImageTest-987683421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:26:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-11f151f5-c4a1-4d2e-a2d0-a746486ff8ad tempest-CreateVolumesFromImageTest-987683421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-11f151f5-c4a1-4d2e-a2d0-a746486ff8ad tempest-CreateVolumesFromImageTest-987683421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:52 devstack sudo[113636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:26:52 devstack sudo[113636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:52 devstack sudo[113633]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17b7885b-b04e-4258-a59e-59c963182d11 1073741824" returned: 0 in 0.863s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17b7885b-b04e-4258-a59e-59c963182d11 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:52 devstack sudo[113641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17b7885b-b04e-4258-a59e-59c963182d11 Jun 29 11:26:52 devstack sudo[113641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:52 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3ea668eb-6079-4158-97b6-e5b72db3bc97 tempest-CreateVolumesFromImageTest-987683421 None] Acquiring lock "cinder-93597b3e-0cda-4fa4-8261-d7b834309482-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:26:52 devstack sudo[113636]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-11f151f5-c4a1-4d2e-a2d0-a746486ff8ad tempest-CreateVolumesFromImageTest-987683421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.687s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:52 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-11f151f5-c4a1-4d2e-a2d0-a746486ff8ad tempest-CreateVolumesFromImageTest-987683421 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:26:52 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-11f151f5-c4a1-4d2e-a2d0-a746486ff8ad tempest-CreateVolumesFromImageTest-987683421 None] Deleted volume successfully. Jun 29 11:26:52 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3ea668eb-6079-4158-97b6-e5b72db3bc97 tempest-CreateVolumesFromImageTest-987683421 None] Lock "cinder-93597b3e-0cda-4fa4-8261-d7b834309482-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:26:52 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-11f151f5-c4a1-4d2e-a2d0-a746486ff8ad tempest-CreateVolumesFromImageTest-987683421 None] Lock "cinder-463db27c-0cf2-4d69-9105-93769f13fb97-delete_volume" released by "delete_volume" :: held 2.334s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:26:53 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3ea668eb-6079-4158-97b6-e5b72db3bc97 tempest-CreateVolumesFromImageTest-987683421 None] Acquiring lock "cinder-quobyte-93597b3e-0cda-4fa4-8261-d7b834309482" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:26:53 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3ea668eb-6079-4158-97b6-e5b72db3bc97 tempest-CreateVolumesFromImageTest-987683421 None] Lock "cinder-quobyte-93597b3e-0cda-4fa4-8261-d7b834309482" acquired by "delete_volume" :: waited 0.015s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:26:53 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b50c32-3ea2-4a19-b23e-d8423d82317b]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:26:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3ea668eb-6079-4158-97b6-e5b72db3bc97 tempest-CreateVolumesFromImageTest-987683421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-93597b3e-0cda-4fa4-8261-d7b834309482 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:53 devstack sudo[113644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-93597b3e-0cda-4fa4-8261-d7b834309482 Jun 29 11:26:53 devstack sudo[113644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:53 devstack sudo[113641]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17b7885b-b04e-4258-a59e-59c963182d11" returned: 0 in 0.665s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:26:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.224s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1436778501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a93f4d17-0eb9-4f4e-95d4-8e414d93942f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5eb9a0b32e452c82f2aca626ce7eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:26:45Z,use_quota=True,user_id='f6235cca7de14311993c0a5a6aa87b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:26:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Creating volume a93f4d17-0eb9-4f4e-95d4-8e414d93942f {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:26:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:26:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:26:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:26:53 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:26:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a93f4d17-0eb9-4f4e-95d4-8e414d93942f 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92460260-3f44-446f-b9c4-30feb515adff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17b7885b-b04e-4258-a59e-59c963182d11', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4dbd6ee-8a0f-41b0-aae4-ab4dbea3e5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:53 devstack sudo[113647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a93f4d17-0eb9-4f4e-95d4-8e414d93942f 1073741824 Jun 29 11:26:53 devstack sudo[113647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:53 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Volume volume-17b7885b-b04e-4258-a59e-59c963182d11 (17b7885b-b04e-4258-a59e-59c963182d11): created successfully Jun 29 11:26:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4dbd6ee-8a0f-41b0-aae4-ab4dbea3e5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Flow 'volume_create_manager' (3c11ab5a-e8e8-4c07-ab96-e95a2c4cf4fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:26:53 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-c35d2dad-dce8-4304-b63c-822ecd3d784a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Created volume successfully. Jun 29 11:26:53 devstack sudo[113644]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3ea668eb-6079-4158-97b6-e5b72db3bc97 tempest-CreateVolumesFromImageTest-987683421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-93597b3e-0cda-4fa4-8261-d7b834309482" returned: 0 in 0.756s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3ea668eb-6079-4158-97b6-e5b72db3bc97 tempest-CreateVolumesFromImageTest-987683421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-93597b3e-0cda-4fa4-8261-d7b834309482 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:53 devstack sudo[113652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-93597b3e-0cda-4fa4-8261-d7b834309482 Jun 29 11:26:53 devstack sudo[113652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:54 devstack sudo[113647]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a93f4d17-0eb9-4f4e-95d4-8e414d93942f 1073741824" returned: 0 in 0.898s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a93f4d17-0eb9-4f4e-95d4-8e414d93942f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:54 devstack sudo[113658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a93f4d17-0eb9-4f4e-95d4-8e414d93942f Jun 29 11:26:54 devstack sudo[113658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:54 devstack sudo[113652]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3ea668eb-6079-4158-97b6-e5b72db3bc97 tempest-CreateVolumesFromImageTest-987683421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-93597b3e-0cda-4fa4-8261-d7b834309482" returned: 0 in 0.682s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:54 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3ea668eb-6079-4158-97b6-e5b72db3bc97 tempest-CreateVolumesFromImageTest-987683421 None] Lock "cinder-quobyte-93597b3e-0cda-4fa4-8261-d7b834309482" released by "delete_volume" :: held 1.489s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:26:54 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-3ea668eb-6079-4158-97b6-e5b72db3bc97 tempest-CreateVolumesFromImageTest-987683421 None] Created reservations ['2afd3ff9-447a-4d75-868d-0910132fbcd3', '6cf39efe-10b0-4599-a691-f59ddb4169a1', 'b132546e-850b-4d21-b454-75a0430dab58', '803ef924-e22a-4cbc-a26c-a9288ccc12a9'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:26:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3ea668eb-6079-4158-97b6-e5b72db3bc97 tempest-CreateVolumesFromImageTest-987683421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3ea668eb-6079-4158-97b6-e5b72db3bc97 tempest-CreateVolumesFromImageTest-987683421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-3ea668eb-6079-4158-97b6-e5b72db3bc97 tempest-CreateVolumesFromImageTest-987683421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:26:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-3ea668eb-6079-4158-97b6-e5b72db3bc97 tempest-CreateVolumesFromImageTest-987683421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:26:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-3ea668eb-6079-4158-97b6-e5b72db3bc97 tempest-CreateVolumesFromImageTest-987683421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3ea668eb-6079-4158-97b6-e5b72db3bc97 tempest-CreateVolumesFromImageTest-987683421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:54 devstack sudo[113661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:26:54 devstack sudo[113661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:54 devstack sudo[113658]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a93f4d17-0eb9-4f4e-95d4-8e414d93942f" returned: 0 in 0.655s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:26:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.200s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2095132468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3353759-7e00-4a9d-bbcf-e9fd2a436fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5eb9a0b32e452c82f2aca626ce7eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:26:45Z,use_quota=True,user_id='f6235cca7de14311993c0a5a6aa87b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:26:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Creating volume c3353759-7e00-4a9d-bbcf-e9fd2a436fb5 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:26:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:26:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:26:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:26:54 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:26:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3353759-7e00-4a9d-bbcf-e9fd2a436fb5 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:54 devstack sudo[113664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3353759-7e00-4a9d-bbcf-e9fd2a436fb5 1073741824 Jun 29 11:26:54 devstack sudo[113664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bba28767-b4ed-41e9-b144-495d7ff8ce2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a93f4d17-0eb9-4f4e-95d4-8e414d93942f', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:54 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc542b22-5ce7-4e92-aab4-a968f4f05aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:54 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Volume volume-a93f4d17-0eb9-4f4e-95d4-8e414d93942f (a93f4d17-0eb9-4f4e-95d4-8e414d93942f): created successfully Jun 29 11:26:55 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc542b22-5ce7-4e92-aab4-a968f4f05aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:55 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Flow 'volume_create_manager' (3222bd96-60a9-4fa6-854c-0b8e86ab1e0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:26:55 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-d65ada89-b0f9-44df-935e-2607d6d1ec94 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Created volume successfully. Jun 29 11:26:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b28e1d23-4620-4d7d-937f-fda67eafc66d tempest-CreateVolumesFromImageTest-987683421 None] Acquiring lock "cinder-f2f7bdf0-2808-4502-8894-93725b28b0b7-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:26:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b28e1d23-4620-4d7d-937f-fda67eafc66d tempest-CreateVolumesFromImageTest-987683421 None] Lock "cinder-f2f7bdf0-2808-4502-8894-93725b28b0b7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:26:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b28e1d23-4620-4d7d-937f-fda67eafc66d tempest-CreateVolumesFromImageTest-987683421 None] Acquiring lock "cinder-quobyte-f2f7bdf0-2808-4502-8894-93725b28b0b7" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:26:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b28e1d23-4620-4d7d-937f-fda67eafc66d tempest-CreateVolumesFromImageTest-987683421 None] Lock "cinder-quobyte-f2f7bdf0-2808-4502-8894-93725b28b0b7" acquired by "delete_volume" :: waited 0.027s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:26:55 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e3d906-6ef2-45c2-9d44-3d37b8ba3371]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:26:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b28e1d23-4620-4d7d-937f-fda67eafc66d tempest-CreateVolumesFromImageTest-987683421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f2f7bdf0-2808-4502-8894-93725b28b0b7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:55 devstack sudo[113661]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-3ea668eb-6079-4158-97b6-e5b72db3bc97 tempest-CreateVolumesFromImageTest-987683421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.721s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:55 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-3ea668eb-6079-4158-97b6-e5b72db3bc97 tempest-CreateVolumesFromImageTest-987683421 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:26:55 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-3ea668eb-6079-4158-97b6-e5b72db3bc97 tempest-CreateVolumesFromImageTest-987683421 None] Deleted volume successfully. Jun 29 11:26:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-3ea668eb-6079-4158-97b6-e5b72db3bc97 tempest-CreateVolumesFromImageTest-987683421 None] Lock "cinder-93597b3e-0cda-4fa4-8261-d7b834309482-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:26:55 devstack sudo[113667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f2f7bdf0-2808-4502-8894-93725b28b0b7 Jun 29 11:26:55 devstack sudo[113667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:55 devstack sudo[113664]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3353759-7e00-4a9d-bbcf-e9fd2a436fb5 1073741824" returned: 0 in 0.870s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3353759-7e00-4a9d-bbcf-e9fd2a436fb5 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:55 devstack sudo[113672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3353759-7e00-4a9d-bbcf-e9fd2a436fb5 Jun 29 11:26:55 devstack sudo[113672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:56 devstack sudo[113667]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b28e1d23-4620-4d7d-937f-fda67eafc66d tempest-CreateVolumesFromImageTest-987683421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f2f7bdf0-2808-4502-8894-93725b28b0b7" returned: 0 in 0.822s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b28e1d23-4620-4d7d-937f-fda67eafc66d tempest-CreateVolumesFromImageTest-987683421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f2f7bdf0-2808-4502-8894-93725b28b0b7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:56 devstack sudo[113677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f2f7bdf0-2808-4502-8894-93725b28b0b7 Jun 29 11:26:56 devstack sudo[113677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:56 devstack sudo[113672]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3353759-7e00-4a9d-bbcf-e9fd2a436fb5" returned: 0 in 0.671s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:26:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.385s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1029757047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b994dd-07d6-4d6c-928b-49bd2a6d3948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5eb9a0b32e452c82f2aca626ce7eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:26:46Z,use_quota=True,user_id='f6235cca7de14311993c0a5a6aa87b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:26:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Creating volume 24b994dd-07d6-4d6c-928b-49bd2a6d3948 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:26:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:26:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:26:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:26:56 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:26:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-24b994dd-07d6-4d6c-928b-49bd2a6d3948 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:56 devstack sudo[113680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-24b994dd-07d6-4d6c-928b-49bd2a6d3948 1073741824 Jun 29 11:26:56 devstack sudo[113680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7910c358-c62c-460e-8488-5c17a4213d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3353759-7e00-4a9d-bbcf-e9fd2a436fb5', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25033c4d-1ce4-45f7-837d-aa10b76728db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:56 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Volume volume-c3353759-7e00-4a9d-bbcf-e9fd2a436fb5 (c3353759-7e00-4a9d-bbcf-e9fd2a436fb5): created successfully Jun 29 11:26:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25033c4d-1ce4-45f7-837d-aa10b76728db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:56 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Flow 'volume_create_manager' (830ff81e-872c-40dd-8e9e-ef9429217889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:26:56 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-7a9cd4e1-d5f8-4e6c-9472-c57ea9828c1c tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Created volume successfully. Jun 29 11:26:56 devstack sudo[113677]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b28e1d23-4620-4d7d-937f-fda67eafc66d tempest-CreateVolumesFromImageTest-987683421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f2f7bdf0-2808-4502-8894-93725b28b0b7" returned: 0 in 0.661s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:56 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b28e1d23-4620-4d7d-937f-fda67eafc66d tempest-CreateVolumesFromImageTest-987683421 None] Lock "cinder-quobyte-f2f7bdf0-2808-4502-8894-93725b28b0b7" released by "delete_volume" :: held 1.529s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:26:56 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-b28e1d23-4620-4d7d-937f-fda67eafc66d tempest-CreateVolumesFromImageTest-987683421 None] Created reservations ['6acc7b54-f5ce-4393-a221-5dc71daa73a2', 'ccaf3009-00c6-465f-a79f-42c2b103205b', '69f6cad4-84db-4834-8fcc-1ad3317ea681', '1845623f-e14b-481c-99b5-ae3d9cf6b17a'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:26:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b28e1d23-4620-4d7d-937f-fda67eafc66d tempest-CreateVolumesFromImageTest-987683421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b28e1d23-4620-4d7d-937f-fda67eafc66d tempest-CreateVolumesFromImageTest-987683421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b28e1d23-4620-4d7d-937f-fda67eafc66d tempest-CreateVolumesFromImageTest-987683421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:26:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b28e1d23-4620-4d7d-937f-fda67eafc66d tempest-CreateVolumesFromImageTest-987683421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:26:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b28e1d23-4620-4d7d-937f-fda67eafc66d tempest-CreateVolumesFromImageTest-987683421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b28e1d23-4620-4d7d-937f-fda67eafc66d tempest-CreateVolumesFromImageTest-987683421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:56 devstack sudo[113683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:26:56 devstack sudo[113683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:57 devstack sudo[113680]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-24b994dd-07d6-4d6c-928b-49bd2a6d3948 1073741824" returned: 0 in 0.880s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:57 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-35d56204-bfcb-4f5e-bc6a-cfe5f65ac5c0 tempest-CreateVolumesFromImageTest-987683421 None] Acquiring lock "cinder-620940a7-d6b0-4a43-b574-63e865e70d73-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:26:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-24b994dd-07d6-4d6c-928b-49bd2a6d3948 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:57 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-35d56204-bfcb-4f5e-bc6a-cfe5f65ac5c0 tempest-CreateVolumesFromImageTest-987683421 None] Lock "cinder-620940a7-d6b0-4a43-b574-63e865e70d73-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:26:57 devstack sudo[113689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-24b994dd-07d6-4d6c-928b-49bd2a6d3948 Jun 29 11:26:57 devstack sudo[113689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:57 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-35d56204-bfcb-4f5e-bc6a-cfe5f65ac5c0 tempest-CreateVolumesFromImageTest-987683421 None] Acquiring lock "cinder-quobyte-620940a7-d6b0-4a43-b574-63e865e70d73" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:26:57 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-35d56204-bfcb-4f5e-bc6a-cfe5f65ac5c0 tempest-CreateVolumesFromImageTest-987683421 None] Lock "cinder-quobyte-620940a7-d6b0-4a43-b574-63e865e70d73" acquired by "delete_volume" :: waited 0.018s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:26:57 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfca46cc-c443-4288-bbd3-0c96e59b4a6f]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:26:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-35d56204-bfcb-4f5e-bc6a-cfe5f65ac5c0 tempest-CreateVolumesFromImageTest-987683421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-620940a7-d6b0-4a43-b574-63e865e70d73 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:57 devstack sudo[113683]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b28e1d23-4620-4d7d-937f-fda67eafc66d tempest-CreateVolumesFromImageTest-987683421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.695s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:57 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-b28e1d23-4620-4d7d-937f-fda67eafc66d tempest-CreateVolumesFromImageTest-987683421 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:26:57 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-b28e1d23-4620-4d7d-937f-fda67eafc66d tempest-CreateVolumesFromImageTest-987683421 None] Deleted volume successfully. Jun 29 11:26:57 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-b28e1d23-4620-4d7d-937f-fda67eafc66d tempest-CreateVolumesFromImageTest-987683421 None] Lock "cinder-f2f7bdf0-2808-4502-8894-93725b28b0b7-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:26:57 devstack sudo[113692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-620940a7-d6b0-4a43-b574-63e865e70d73 Jun 29 11:26:57 devstack sudo[113692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:58 devstack sudo[113689]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-24b994dd-07d6-4d6c-928b-49bd2a6d3948" returned: 0 in 0.740s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:58 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:26:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.210s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:58 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f7a97e0-c685-409c-9d3a-40dbdbb6fd13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04364cda717644b797a7a0bec8ca3e3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:26:42Z,use_quota=True,user_id='0187fad7449f4846a369cd82c8bcad6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:26:58 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Creating volume 4f7a97e0-c685-409c-9d3a-40dbdbb6fd13 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:26:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:58 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:26:58 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:26:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:58 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:26:58 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:26:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d9883a-8888-41ae-b980-6db7bd13b2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24b994dd-07d6-4d6c-928b-49bd2a6d3948', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e87c9e-4033-4fd4-82cd-9f86f9267c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:26:58 devstack sudo[113733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13 1073741824 Jun 29 11:26:58 devstack sudo[113733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:58 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Volume volume-24b994dd-07d6-4d6c-928b-49bd2a6d3948 (24b994dd-07d6-4d6c-928b-49bd2a6d3948): created successfully Jun 29 11:26:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e87c9e-4033-4fd4-82cd-9f86f9267c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:26:58 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Flow 'volume_create_manager' (0d1450c8-6cd4-4220-a8ee-2505d4a2a2cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:26:58 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-11f529d1-9234-4dc7-992f-3a4af3bbfce7 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Created volume successfully. Jun 29 11:26:58 devstack sudo[113692]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-35d56204-bfcb-4f5e-bc6a-cfe5f65ac5c0 tempest-CreateVolumesFromImageTest-987683421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-620940a7-d6b0-4a43-b574-63e865e70d73" returned: 0 in 0.803s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-35d56204-bfcb-4f5e-bc6a-cfe5f65ac5c0 tempest-CreateVolumesFromImageTest-987683421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-620940a7-d6b0-4a43-b574-63e865e70d73 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:58 devstack sudo[113737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-620940a7-d6b0-4a43-b574-63e865e70d73 Jun 29 11:26:58 devstack sudo[113737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:58 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a711fbf6-c413-4eb8-8e84-ef5aeaf2bcf2 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Acquiring lock "cinder-24b994dd-07d6-4d6c-928b-49bd2a6d3948-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a711fbf6-c413-4eb8-8e84-ef5aeaf2bcf2 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "cinder-24b994dd-07d6-4d6c-928b-49bd2a6d3948-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a711fbf6-c413-4eb8-8e84-ef5aeaf2bcf2 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Acquiring lock "cinder-quobyte-24b994dd-07d6-4d6c-928b-49bd2a6d3948" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a711fbf6-c413-4eb8-8e84-ef5aeaf2bcf2 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "cinder-quobyte-24b994dd-07d6-4d6c-928b-49bd2a6d3948" acquired by "delete_volume" :: waited 0.015s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:26:59 devstack sudo[113737]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-35d56204-bfcb-4f5e-bc6a-cfe5f65ac5c0 tempest-CreateVolumesFromImageTest-987683421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-620940a7-d6b0-4a43-b574-63e865e70d73" returned: 0 in 0.695s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[59197ffd-307d-4d5c-a7ab-73f3baee32f5]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a711fbf6-c413-4eb8-8e84-ef5aeaf2bcf2 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-24b994dd-07d6-4d6c-928b-49bd2a6d3948 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-35d56204-bfcb-4f5e-bc6a-cfe5f65ac5c0 tempest-CreateVolumesFromImageTest-987683421 None] Lock "cinder-quobyte-620940a7-d6b0-4a43-b574-63e865e70d73" released by "delete_volume" :: held 1.550s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:26:59 devstack sudo[113733]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13 1073741824" returned: 0 in 0.927s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-35d56204-bfcb-4f5e-bc6a-cfe5f65ac5c0 tempest-CreateVolumesFromImageTest-987683421 None] Created reservations ['f0ec2aae-d9aa-4d9f-a1de-fb0732909daf', 'f1ea6aa5-db70-47c9-8154-fcc300ee50c7', '6002a4ce-ce2c-48dc-88b6-301752a98fbe', '5c827fe1-6d37-40b0-90ba-9a37ad542d57'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:59 devstack sudo[113745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-24b994dd-07d6-4d6c-928b-49bd2a6d3948 Jun 29 11:26:59 devstack sudo[113745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:59 devstack sudo[113746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13 Jun 29 11:26:59 devstack sudo[113746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-35d56204-bfcb-4f5e-bc6a-cfe5f65ac5c0 tempest-CreateVolumesFromImageTest-987683421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-35d56204-bfcb-4f5e-bc6a-cfe5f65ac5c0 tempest-CreateVolumesFromImageTest-987683421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-35d56204-bfcb-4f5e-bc6a-cfe5f65ac5c0 tempest-CreateVolumesFromImageTest-987683421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-35d56204-bfcb-4f5e-bc6a-cfe5f65ac5c0 tempest-CreateVolumesFromImageTest-987683421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-35d56204-bfcb-4f5e-bc6a-cfe5f65ac5c0 tempest-CreateVolumesFromImageTest-987683421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-35d56204-bfcb-4f5e-bc6a-cfe5f65ac5c0 tempest-CreateVolumesFromImageTest-987683421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:59 devstack sudo[113749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:26:59 devstack sudo[113749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f7c32a9b-08e9-4f17-9149-4a6b64554852 tempest-CreateVolumesFromImageTest-987683421 None] Acquiring lock "cinder-0814562b-e012-4191-9ef1-71cbc50a2425-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f7c32a9b-08e9-4f17-9149-4a6b64554852 tempest-CreateVolumesFromImageTest-987683421 None] Lock "cinder-0814562b-e012-4191-9ef1-71cbc50a2425-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f7c32a9b-08e9-4f17-9149-4a6b64554852 tempest-CreateVolumesFromImageTest-987683421 None] Acquiring lock "cinder-quobyte-0814562b-e012-4191-9ef1-71cbc50a2425" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f7c32a9b-08e9-4f17-9149-4a6b64554852 tempest-CreateVolumesFromImageTest-987683421 None] Lock "cinder-quobyte-0814562b-e012-4191-9ef1-71cbc50a2425" acquired by "delete_volume" :: waited 0.017s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01408e1-01c8-4139-b1fe-7c3d0d116f8e]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f7c32a9b-08e9-4f17-9149-4a6b64554852 tempest-CreateVolumesFromImageTest-987683421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0814562b-e012-4191-9ef1-71cbc50a2425 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:59 devstack sudo[113746]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13" returned: 0 in 0.707s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.216s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57d8bc61e5784a689d548c0f71262ef9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:26:43Z,use_quota=True,user_id='6d3bb171e2c744369a8ca54ee1aa1cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df96f11e-1cdf-4e9a-bbd8-643b1ba27ae2),volume_type_id=df96f11e-1cdf-4e9a-bbd8-643b1ba27ae2)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Creating volume ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:26:59 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG cinder.volume.volume_utils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Attempting download of cf24f77f-467a-45d9-a408-9464f5c269d2 ((None, [{'url': 'file:///opt/stack/data/glance/images/cf24f77f-467a-45d9-a408-9464f5c269d2', 'metadata': {}}])) to volume 4f7a97e0-c685-409c-9d3a-40dbdbb6fd13. {{(pid=93497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 29 11:26:59 devstack sudo[113745]: pam_unix(sudo:session): session closed for user root Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a711fbf6-c413-4eb8-8e84-ef5aeaf2bcf2 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-24b994dd-07d6-4d6c-928b-49bd2a6d3948" returned: 0 in 0.869s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:26:59 devstack sudo[113756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04 1073741824 Jun 29 11:26:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a711fbf6-c413-4eb8-8e84-ef5aeaf2bcf2 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-24b994dd-07d6-4d6c-928b-49bd2a6d3948 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:26:59 devstack sudo[113756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:00 devstack sudo[113759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-24b994dd-07d6-4d6c-928b-49bd2a6d3948 Jun 29 11:27:00 devstack sudo[113759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:00 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ca7733-588b-4982-9a84-c506c2ee3af5]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf24f77f-467a-45d9-a408-9464f5c269d2_0xm88fm5 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:00 devstack sudo[113755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0814562b-e012-4191-9ef1-71cbc50a2425 Jun 29 11:27:00 devstack sudo[113755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:00 devstack sudo[113749]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-35d56204-bfcb-4f5e-bc6a-cfe5f65ac5c0 tempest-CreateVolumesFromImageTest-987683421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.828s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:00 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-35d56204-bfcb-4f5e-bc6a-cfe5f65ac5c0 tempest-CreateVolumesFromImageTest-987683421 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:27:00 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-35d56204-bfcb-4f5e-bc6a-cfe5f65ac5c0 tempest-CreateVolumesFromImageTest-987683421 None] Deleted volume successfully. Jun 29 11:27:00 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-35d56204-bfcb-4f5e-bc6a-cfe5f65ac5c0 tempest-CreateVolumesFromImageTest-987683421 None] Lock "cinder-620940a7-d6b0-4a43-b574-63e865e70d73-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:00 devstack sudo[113761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf24f77f-467a-45d9-a408-9464f5c269d2_0xm88fm5 Jun 29 11:27:00 devstack sudo[113761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:00 devstack sudo[113756]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04 1073741824" returned: 0 in 0.917s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:00 devstack sudo[113759]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a711fbf6-c413-4eb8-8e84-ef5aeaf2bcf2 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-24b994dd-07d6-4d6c-928b-49bd2a6d3948" returned: 0 in 0.888s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:00 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a711fbf6-c413-4eb8-8e84-ef5aeaf2bcf2 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "cinder-quobyte-24b994dd-07d6-4d6c-928b-49bd2a6d3948" released by "delete_volume" :: held 1.800s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:00 devstack sudo[113775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04 Jun 29 11:27:00 devstack sudo[113775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:00 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-a711fbf6-c413-4eb8-8e84-ef5aeaf2bcf2 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Created reservations ['14278c79-302c-4867-b735-391fb30bb67d', 'cff66035-ca0c-4f1d-bcc6-2555b9d32192', '36f3fa44-3c4e-4314-9165-4c0aa41481b9', '963f914f-3c24-49e5-94c2-a667f5a03cff'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:27:00 devstack sudo[113755]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f7c32a9b-08e9-4f17-9149-4a6b64554852 tempest-CreateVolumesFromImageTest-987683421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0814562b-e012-4191-9ef1-71cbc50a2425" returned: 0 in 1.083s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f7c32a9b-08e9-4f17-9149-4a6b64554852 tempest-CreateVolumesFromImageTest-987683421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0814562b-e012-4191-9ef1-71cbc50a2425 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:00 devstack sudo[113761]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf24f77f-467a-45d9-a408-9464f5c269d2_0xm88fm5" returned: 0 in 0.937s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf24f77f-467a-45d9-a408-9464f5c269d2_0xm88fm5 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:00 devstack sudo[113777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0814562b-e012-4191-9ef1-71cbc50a2425 Jun 29 11:27:00 devstack sudo[113777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a711fbf6-c413-4eb8-8e84-ef5aeaf2bcf2 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a711fbf6-c413-4eb8-8e84-ef5aeaf2bcf2 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:01 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a711fbf6-c413-4eb8-8e84-ef5aeaf2bcf2 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:27:01 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a711fbf6-c413-4eb8-8e84-ef5aeaf2bcf2 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:27:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a711fbf6-c413-4eb8-8e84-ef5aeaf2bcf2 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a711fbf6-c413-4eb8-8e84-ef5aeaf2bcf2 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:01 devstack sudo[113779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf24f77f-467a-45d9-a408-9464f5c269d2_0xm88fm5 Jun 29 11:27:01 devstack sudo[113779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:01 devstack sudo[113780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:27:01 devstack sudo[113780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-5c5af148-21ea-466a-bc6f-517543335fc6 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Acquiring lock "cinder-c3353759-7e00-4a9d-bbcf-e9fd2a436fb5-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-5c5af148-21ea-466a-bc6f-517543335fc6 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "cinder-c3353759-7e00-4a9d-bbcf-e9fd2a436fb5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-5c5af148-21ea-466a-bc6f-517543335fc6 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Acquiring lock "cinder-quobyte-c3353759-7e00-4a9d-bbcf-e9fd2a436fb5" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-5c5af148-21ea-466a-bc6f-517543335fc6 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "cinder-quobyte-c3353759-7e00-4a9d-bbcf-e9fd2a436fb5" acquired by "delete_volume" :: waited 0.028s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:01 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c1001c-a731-4269-ba78-6170c9ad21fd]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5c5af148-21ea-466a-bc6f-517543335fc6 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3353759-7e00-4a9d-bbcf-e9fd2a436fb5 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:01 devstack sudo[113783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3353759-7e00-4a9d-bbcf-e9fd2a436fb5 Jun 29 11:27:01 devstack sudo[113783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:01 devstack sudo[113777]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f7c32a9b-08e9-4f17-9149-4a6b64554852 tempest-CreateVolumesFromImageTest-987683421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0814562b-e012-4191-9ef1-71cbc50a2425" returned: 0 in 0.812s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f7c32a9b-08e9-4f17-9149-4a6b64554852 tempest-CreateVolumesFromImageTest-987683421 None] Lock "cinder-quobyte-0814562b-e012-4191-9ef1-71cbc50a2425" released by "delete_volume" :: held 1.950s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:01 devstack sudo[113775]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04" returned: 0 in 0.954s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:01 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] <== create_volume: return (1949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:27:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.953s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:01 devstack cinder-volume[93497]: DEBUG cinder.volume.volume_utils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Attempting download of c2f56963-c5ec-47f4-a61b-d219dfee2fa7 ((None, [{'url': 'file:///opt/stack/data/glance/images/c2f56963-c5ec-47f4-a61b-d219dfee2fa7', 'metadata': {}}])) to volume ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04. {{(pid=93497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 29 11:27:01 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-f7c32a9b-08e9-4f17-9149-4a6b64554852 tempest-CreateVolumesFromImageTest-987683421 None] Created reservations ['83d2fee6-699d-41b6-850d-b421f18d73d8', '76e7e15e-66dc-4d8f-964d-8ec2c77b9316', '4e9f5e03-79fb-4fd5-aca1-dea725b04b3a', '96a60bc0-d442-4998-85f2-3f50ff81f157'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:27:01 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9babd226-1f95-443c-ab84-ea36a1647b26]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_u41xkbyx {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f7c32a9b-08e9-4f17-9149-4a6b64554852 tempest-CreateVolumesFromImageTest-987683421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f7c32a9b-08e9-4f17-9149-4a6b64554852 tempest-CreateVolumesFromImageTest-987683421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:02 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f7c32a9b-08e9-4f17-9149-4a6b64554852 tempest-CreateVolumesFromImageTest-987683421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:27:02 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-f7c32a9b-08e9-4f17-9149-4a6b64554852 tempest-CreateVolumesFromImageTest-987683421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:27:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-f7c32a9b-08e9-4f17-9149-4a6b64554852 tempest-CreateVolumesFromImageTest-987683421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f7c32a9b-08e9-4f17-9149-4a6b64554852 tempest-CreateVolumesFromImageTest-987683421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:02 devstack sudo[113791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:27:02 devstack sudo[113791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:02 devstack sudo[113779]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf24f77f-467a-45d9-a408-9464f5c269d2_0xm88fm5" returned: 1 in 1.190s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf24f77f-467a-45d9-a408-9464f5c269d2_0xm88fm5' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:27:02 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[733b9d2f-0376-479e-9dbe-f78780aee742]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf24f77f-467a-45d9-a408-9464f5c269d2_953_i15adevstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:02 devstack sudo[113780]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:02 devstack sudo[113790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_u41xkbyx Jun 29 11:27:02 devstack sudo[113790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a711fbf6-c413-4eb8-8e84-ef5aeaf2bcf2 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.134s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:02 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-a711fbf6-c413-4eb8-8e84-ef5aeaf2bcf2 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:27:02 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-a711fbf6-c413-4eb8-8e84-ef5aeaf2bcf2 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Deleted volume successfully. Jun 29 11:27:02 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a711fbf6-c413-4eb8-8e84-ef5aeaf2bcf2 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "cinder-24b994dd-07d6-4d6c-928b-49bd2a6d3948-delete_volume" released by "delete_volume" :: held 3.273s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:02 devstack sudo[113794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf24f77f-467a-45d9-a408-9464f5c269d2_953_i15adevstack@QuobyteHD Jun 29 11:27:02 devstack sudo[113794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:02 devstack sudo[113783]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5c5af148-21ea-466a-bc6f-517543335fc6 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3353759-7e00-4a9d-bbcf-e9fd2a436fb5" returned: 0 in 1.229s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5c5af148-21ea-466a-bc6f-517543335fc6 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3353759-7e00-4a9d-bbcf-e9fd2a436fb5 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:02 devstack sudo[113800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3353759-7e00-4a9d-bbcf-e9fd2a436fb5 Jun 29 11:27:02 devstack sudo[113800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:02 devstack sudo[113791]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-f7c32a9b-08e9-4f17-9149-4a6b64554852 tempest-CreateVolumesFromImageTest-987683421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.914s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:02 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-f7c32a9b-08e9-4f17-9149-4a6b64554852 tempest-CreateVolumesFromImageTest-987683421 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:27:02 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-f7c32a9b-08e9-4f17-9149-4a6b64554852 tempest-CreateVolumesFromImageTest-987683421 None] Deleted volume successfully. Jun 29 11:27:02 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-f7c32a9b-08e9-4f17-9149-4a6b64554852 tempest-CreateVolumesFromImageTest-987683421 None] Lock "cinder-0814562b-e012-4191-9ef1-71cbc50a2425-delete_volume" released by "delete_volume" :: held 3.236s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:03 devstack sudo[113790]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_u41xkbyx" returned: 0 in 1.026s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_u41xkbyx {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:03 devstack sudo[113804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_u41xkbyx Jun 29 11:27:03 devstack sudo[113804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:03 devstack sudo[113794]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cf24f77f-467a-45d9-a408-9464f5c269d2_953_i15adevstack@QuobyteHD" returned: 0 in 1.102s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf24f77f-467a-45d9-a408-9464f5c269d2_953_i15adevstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:03 devstack sudo[113808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf24f77f-467a-45d9-a408-9464f5c269d2_953_i15adevstack@QuobyteHD Jun 29 11:27:03 devstack sudo[113808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:03 devstack sudo[113800]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5c5af148-21ea-466a-bc6f-517543335fc6 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3353759-7e00-4a9d-bbcf-e9fd2a436fb5" returned: 0 in 0.759s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-5c5af148-21ea-466a-bc6f-517543335fc6 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "cinder-quobyte-c3353759-7e00-4a9d-bbcf-e9fd2a436fb5" released by "delete_volume" :: held 2.076s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:03 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-5c5af148-21ea-466a-bc6f-517543335fc6 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Created reservations ['f69af18d-7994-41db-a43f-feb128fcc54b', '47a0551b-3639-4928-8c45-b659e08333ed', '22814dab-50c0-4ce6-b5d3-5ac0c6eed459', 'd8bf25fc-9cfd-4803-bff7-841f4d5f96f5'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:27:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5c5af148-21ea-466a-bc6f-517543335fc6 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5c5af148-21ea-466a-bc6f-517543335fc6 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:03 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5c5af148-21ea-466a-bc6f-517543335fc6 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:27:03 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5c5af148-21ea-466a-bc6f-517543335fc6 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:27:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5c5af148-21ea-466a-bc6f-517543335fc6 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5c5af148-21ea-466a-bc6f-517543335fc6 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:03 devstack sudo[113811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:27:03 devstack sudo[113811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-7b99e861-6821-4ee6-a748-48d1219e55e9 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Acquiring lock "cinder-a93f4d17-0eb9-4f4e-95d4-8e414d93942f-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-7b99e861-6821-4ee6-a748-48d1219e55e9 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "cinder-a93f4d17-0eb9-4f4e-95d4-8e414d93942f-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:04 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-7b99e861-6821-4ee6-a748-48d1219e55e9 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Acquiring lock "cinder-quobyte-a93f4d17-0eb9-4f4e-95d4-8e414d93942f" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:04 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-7b99e861-6821-4ee6-a748-48d1219e55e9 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "cinder-quobyte-a93f4d17-0eb9-4f4e-95d4-8e414d93942f" acquired by "delete_volume" :: waited 0.044s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:04 devstack sudo[113804]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_u41xkbyx" returned: 1 in 1.064s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_u41xkbyx' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:27:04 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[01897a51-1650-4c08-92db-18bd41b4d88f]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_6n4u3vkpdevstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:04 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc625749-8d14-41b0-9127-5c9b00731a3c]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7b99e861-6821-4ee6-a748-48d1219e55e9 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a93f4d17-0eb9-4f4e-95d4-8e414d93942f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:04 devstack sudo[113818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a93f4d17-0eb9-4f4e-95d4-8e414d93942f Jun 29 11:27:04 devstack sudo[113818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:04 devstack sudo[113817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_6n4u3vkpdevstack@QuobyteHD Jun 29 11:27:04 devstack sudo[113817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:04 devstack sudo[113808]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf24f77f-467a-45d9-a408-9464f5c269d2_953_i15adevstack@QuobyteHD" returned: 1 in 1.043s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cf24f77f-467a-45d9-a408-9464f5c269d2_953_i15adevstack@QuobyteHD' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:27:04 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] cf24f77f-467a-45d9-a408-9464f5c269d2 was raw, converting to raw {{(pid=93497) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 29 11:27:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cf24f77f-467a-45d9-a408-9464f5c269d2_953_i15adevstack@QuobyteHD /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:04 devstack sudo[113824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cf24f77f-467a-45d9-a408-9464f5c269d2_953_i15adevstack@QuobyteHD /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13 Jun 29 11:27:04 devstack sudo[113824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:04 devstack sudo[113811]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5c5af148-21ea-466a-bc6f-517543335fc6 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.122s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:04 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-5c5af148-21ea-466a-bc6f-517543335fc6 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:27:04 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-5c5af148-21ea-466a-bc6f-517543335fc6 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Deleted volume successfully. Jun 29 11:27:04 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-5c5af148-21ea-466a-bc6f-517543335fc6 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "cinder-c3353759-7e00-4a9d-bbcf-e9fd2a436fb5-delete_volume" released by "delete_volume" :: held 3.476s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:05 devstack sudo[113817]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_6n4u3vkpdevstack@QuobyteHD" returned: 0 in 0.944s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_6n4u3vkpdevstack@QuobyteHD {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:05 devstack sudo[113818]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7b99e861-6821-4ee6-a748-48d1219e55e9 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a93f4d17-0eb9-4f4e-95d4-8e414d93942f" returned: 0 in 1.049s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7b99e861-6821-4ee6-a748-48d1219e55e9 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a93f4d17-0eb9-4f4e-95d4-8e414d93942f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:05 devstack sudo[113836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a93f4d17-0eb9-4f4e-95d4-8e414d93942f Jun 29 11:27:05 devstack sudo[113836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:05 devstack sudo[113833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_6n4u3vkpdevstack@QuobyteHD Jun 29 11:27:05 devstack sudo[113833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:05 devstack sudo[113824]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_cf24f77f-467a-45d9-a408-9464f5c269d2_953_i15adevstack@QuobyteHD /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13" returned: 0 in 1.070s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:05 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cf24f77f-467a-45d9-a408-9464f5c269d2_953_i15adevstack@QuobyteHD, size 0.00 MB, duration 1.07 sec, destination /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13 {{(pid=93497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 11:27:05 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Converted 0.00 MB image at 0.00 MB/s Jun 29 11:27:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:05 devstack sudo[113840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13 1G Jun 29 11:27:05 devstack sudo[113840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:05 devstack sudo[113833]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:05 devstack sudo[113836]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_6n4u3vkpdevstack@QuobyteHD" returned: 1 in 0.834s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_6n4u3vkpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:27:05 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] c2f56963-c5ec-47f4-a61b-d219dfee2fa7 was raw, converting to raw {{(pid=93497) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 29 11:27:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_6n4u3vkpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7b99e861-6821-4ee6-a748-48d1219e55e9 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a93f4d17-0eb9-4f4e-95d4-8e414d93942f" returned: 0 in 0.732s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:05 devstack sudo[113846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_6n4u3vkpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04 Jun 29 11:27:05 devstack sudo[113846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:05 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-7b99e861-6821-4ee6-a748-48d1219e55e9 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "cinder-quobyte-a93f4d17-0eb9-4f4e-95d4-8e414d93942f" released by "delete_volume" :: held 1.850s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:05 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-7b99e861-6821-4ee6-a748-48d1219e55e9 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Created reservations ['f32cec73-82b1-4e1d-a020-e9bec99c3363', 'e6fd8c00-9c2c-44d4-9ce0-0fc9883e8de4', 'a34c802b-10ed-420c-8efe-50fc948cf511', '3be99fd9-016a-4207-b007-747fa206b908'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7b99e861-6821-4ee6-a748-48d1219e55e9 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7b99e861-6821-4ee6-a748-48d1219e55e9 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7b99e861-6821-4ee6-a748-48d1219e55e9 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7b99e861-6821-4ee6-a748-48d1219e55e9 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7b99e861-6821-4ee6-a748-48d1219e55e9 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7b99e861-6821-4ee6-a748-48d1219e55e9 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:06 devstack sudo[113851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:27:06 devstack sudo[113851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:06 devstack sudo[113840]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13 1G" returned: 0 in 0.909s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-971c5994-4879-4831-ac95-74884369337a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Acquiring lock "cinder-17b7885b-b04e-4258-a59e-59c963182d11-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-971c5994-4879-4831-ac95-74884369337a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "cinder-17b7885b-b04e-4258-a59e-59c963182d11-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e578dea-305a-4af6-9955-6dacbf2ed26c]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-971c5994-4879-4831-ac95-74884369337a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Acquiring lock "cinder-quobyte-17b7885b-b04e-4258-a59e-59c963182d11" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-971c5994-4879-4831-ac95-74884369337a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "cinder-quobyte-17b7885b-b04e-4258-a59e-59c963182d11" acquired by "delete_volume" :: waited 0.040s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[608477af-abd9-452c-821e-abaedac002f3]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-971c5994-4879-4831-ac95-74884369337a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17b7885b-b04e-4258-a59e-59c963182d11 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:06 devstack sudo[113853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13 Jun 29 11:27:06 devstack sudo[113853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:27:06 devstack sudo[113855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17b7885b-b04e-4258-a59e-59c963182d11 Jun 29 11:27:06 devstack sudo[113855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] Flow 'volume_create_manager' (f91c5c2f-eb8c-404f-a93a-ec3effe1e576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afb3e58e-f9a1-403f-93d9-fe33cd3334bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afb3e58e-f9a1-403f-93d9-fe33cd3334bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-889392997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a42d51e-620a-44d6-854c-a7716b83f578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f346dcbb09a4bc4bb47d10541e2ec7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:27:07Z,use_quota=True,user_id='13ca08e1ce504ca296ff27da763c2f6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (861a709b-bba1-4b06-967c-7d6d1731c744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (861a709b-bba1-4b06-967c-7d6d1731c744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ebd2a9-2dd9-4935-86cd-45fa91ba7b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ebd2a9-2dd9-4935-86cd-45fa91ba7b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a42d51e-620a-44d6-854c-a7716b83f578', 'volume_name': 'volume-0a42d51e-620a-44d6-854c-a7716b83f578', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe6040b-f12d-4352-9241-74e419a403df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe6040b-f12d-4352-9241-74e419a403df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67801249-f62d-481d-a8e7-e0204b83cb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:06 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] Volume 0a42d51e-620a-44d6-854c-a7716b83f578: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a42d51e-620a-44d6-854c-a7716b83f578', 'volume_size': 1} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-889392997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a42d51e-620a-44d6-854c-a7716b83f578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f346dcbb09a4bc4bb47d10541e2ec7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:27:07Z,use_quota=True,user_id='13ca08e1ce504ca296ff27da763c2f6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] Creating volume 0a42d51e-620a-44d6-854c-a7716b83f578 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:27:06 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:06 devstack sudo[113851]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7b99e861-6821-4ee6-a748-48d1219e55e9 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.839s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:06 devstack sudo[113861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578 1073741824 Jun 29 11:27:06 devstack sudo[113861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-7b99e861-6821-4ee6-a748-48d1219e55e9 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:27:06 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-7b99e861-6821-4ee6-a748-48d1219e55e9 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Deleted volume successfully. Jun 29 11:27:06 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-7b99e861-6821-4ee6-a748-48d1219e55e9 tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "cinder-a93f4d17-0eb9-4f4e-95d4-8e414d93942f-delete_volume" released by "delete_volume" :: held 3.098s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:07 devstack sudo[113846]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_6n4u3vkpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04" returned: 0 in 1.229s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:07 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c2f56963-c5ec-47f4-a61b-d219dfee2fa7_6n4u3vkpdevstack@QuobyteHD, size 0.00 MB, duration 1.23 sec, destination /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04 {{(pid=93497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 11:27:07 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Converted 0.00 MB image at 0.00 MB/s Jun 29 11:27:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:07 devstack sudo[113863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04 1G Jun 29 11:27:07 devstack sudo[113863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:07 devstack sudo[113853]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13" returned: 0 in 0.936s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:07 devstack sudo[113867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13 Jun 29 11:27:07 devstack sudo[113867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:07 devstack sudo[113855]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-971c5994-4879-4831-ac95-74884369337a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17b7885b-b04e-4258-a59e-59c963182d11" returned: 0 in 1.052s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-971c5994-4879-4831-ac95-74884369337a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17b7885b-b04e-4258-a59e-59c963182d11 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:07 devstack sudo[113874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17b7885b-b04e-4258-a59e-59c963182d11 Jun 29 11:27:07 devstack sudo[113874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:07 devstack sudo[113863]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04 1G" returned: 0 in 0.827s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:07 devstack sudo[113861]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578 1073741824" returned: 0 in 1.048s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ae5971-f04a-4a9b-b62e-449b349dfb28]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:27:08 devstack sudo[113883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578 Jun 29 11:27:08 devstack sudo[113883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:08 devstack sudo[113885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:27:08 devstack sudo[113885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:08 devstack sudo[113882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04 Jun 29 11:27:08 devstack sudo[113882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:08 devstack sudo[113867]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13" returned: 1 in 0.992s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG cinder.volume.volume_utils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Downloaded image cf24f77f-467a-45d9-a408-9464f5c269d2 ((None, [{'url': 'file:///opt/stack/data/glance/images/cf24f77f-467a-45d9-a408-9464f5c269d2', 'metadata': {}}])) to volume 4f7a97e0-c685-409c-9d3a-40dbdbb6fd13 successfully. {{(pid=93497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Temporary image cf24f77f-467a-45d9-a408-9464f5c269d2 for user 0187fad7449f4846a369cd82c8bcad6a is deleted. {{(pid=93497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG cinder.volume.volume_utils [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Marking volume 4f7a97e0-c685-409c-9d3a-40dbdbb6fd13 as bootable. {{(pid=93497) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Copying metadata from image cf24f77f-467a-45d9-a408-9464f5c269d2 to 4f7a97e0-c685-409c-9d3a-40dbdbb6fd13. {{(pid=93497) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Creating volume glance metadata for volume 4f7a97e0-c685-409c-9d3a-40dbdbb6fd13 backed by image cf24f77f-467a-45d9-a408-9464f5c269d2 with: {'image_id': 'cf24f77f-467a-45d9-a408-9464f5c269d2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '72dd931807c158bc47a891a82cb8d00c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93497) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 29 11:27:08 devstack sudo[113874]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-971c5994-4879-4831-ac95-74884369337a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-17b7885b-b04e-4258-a59e-59c963182d11" returned: 0 in 0.810s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-971c5994-4879-4831-ac95-74884369337a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "cinder-quobyte-17b7885b-b04e-4258-a59e-59c963182d11" released by "delete_volume" :: held 1.935s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6586a9d-639c-4c5d-bf3a-213cc1c3a72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13', 'volume_size': 1, 'image_id': 'cf24f77f-467a-45d9-a408-9464f5c269d2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf24f77f-467a-45d9-a408-9464f5c269d2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '72dd931807c158bc47a891a82cb8d00c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '04364cda717644b797a7a0bec8ca3e3f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0735a162855b01a9675b68210183d4364a91550ec5e8378ee123010579ab0e21f937370d85ba7a4ef48a87e359f34b2ea3060a02080d1092e0b67dc5412b9bc9', 'id': 'cf24f77f-467a-45d9-a408-9464f5c269d2', 'created_at': datetime.datetime(2026, 6, 29, 9, 26, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 9, 26, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf24f77f-467a-45d9-a408-9464f5c269d2/file', 'properties': {}}, 'image_service': }' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc26ab66-0fde-43ea-82b3-d256ad9f9df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:08 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Volume volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13 (4f7a97e0-c685-409c-9d3a-40dbdbb6fd13): created successfully Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc26ab66-0fde-43ea-82b3-d256ad9f9df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Flow 'volume_create_manager' (b8febdd4-2984-49ec-a528-2035fdb9a08f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:27:08 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-1dbf5ffb-9796-477f-bcde-ecfc8861b4c5 tempest-VolumeImageDependencyTests-1012582363 None] Created volume successfully. Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-971c5994-4879-4831-ac95-74884369337a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Created reservations ['fe3d57e4-6c33-41da-a937-bf6fa18826a0', '982189be-1f0c-4f66-a715-5aeb161370a5', 'c311f15a-27fc-4c54-abce-220034896373', 'e5e9a24a-7053-42cf-bb36-915c51fe305a'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-971c5994-4879-4831-ac95-74884369337a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-971c5994-4879-4831-ac95-74884369337a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-971c5994-4879-4831-ac95-74884369337a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-971c5994-4879-4831-ac95-74884369337a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-971c5994-4879-4831-ac95-74884369337a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-971c5994-4879-4831-ac95-74884369337a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:08 devstack sudo[113892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:27:08 devstack sudo[113892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:08 devstack sudo[113885]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.850s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager._thread_info {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread count: 29 {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread info: [<_MainThread(MainThread, started 131117520400512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 11:27:08 devstack sudo[113883]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578" returned: 0 in 0.963s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] <== create_volume: return (2088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:27:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.090s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:09 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67801249-f62d-481d-a8e7-e0204b83cb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a42d51e-620a-44d6-854c-a7716b83f578', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:09 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf76e4e-e928-408a-8bae-947a1d49a17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:09 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] Volume volume-0a42d51e-620a-44d6-854c-a7716b83f578 (0a42d51e-620a-44d6-854c-a7716b83f578): created successfully Jun 29 11:27:09 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf76e4e-e928-408a-8bae-947a1d49a17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:09 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] Flow 'volume_create_manager' (f91c5c2f-eb8c-404f-a93a-ec3effe1e576) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:27:09 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-b4f199d9-52cb-4664-9f22-fef3643685d1 tempest-VolumeDependencyTests-932768818 None] Created volume successfully. Jun 29 11:27:09 devstack sudo[113882]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04" returned: 0 in 1.099s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:09 devstack sudo[113898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04 Jun 29 11:27:09 devstack sudo[113898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:09 devstack sudo[113892]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-971c5994-4879-4831-ac95-74884369337a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.707s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:09 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-971c5994-4879-4831-ac95-74884369337a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:27:09 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-971c5994-4879-4831-ac95-74884369337a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Deleted volume successfully. Jun 29 11:27:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-971c5994-4879-4831-ac95-74884369337a tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "cinder-17b7885b-b04e-4258-a59e-59c963182d11-delete_volume" released by "delete_volume" :: held 3.075s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2a90415f-01f2-4882-bc36-87716f342c5f tempest-VolumeImageDependencyTests-1012582363 None] Acquiring lock "cinder-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2a90415f-01f2-4882-bc36-87716f342c5f tempest-VolumeImageDependencyTests-1012582363 None] Lock "cinder-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2a90415f-01f2-4882-bc36-87716f342c5f tempest-VolumeImageDependencyTests-1012582363 None] Acquiring lock "cinder-quobyte-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2a90415f-01f2-4882-bc36-87716f342c5f tempest-VolumeImageDependencyTests-1012582363 None] Lock "cinder-quobyte-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13" acquired by "delete_volume" :: waited 0.030s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:09 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a430f5-85d2-4fcc-97b7-c2099097ee79]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2a90415f-01f2-4882-bc36-87716f342c5f tempest-VolumeImageDependencyTests-1012582363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fe6d1284-bb8c-4ca1-a655-f828a48a288d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Acquiring lock "cinder-f9213451-2db1-4d48-93d9-05a5cd1bc9ed-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fe6d1284-bb8c-4ca1-a655-f828a48a288d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "cinder-f9213451-2db1-4d48-93d9-05a5cd1bc9ed-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:09 devstack sudo[113902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13 Jun 29 11:27:09 devstack sudo[113902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fe6d1284-bb8c-4ca1-a655-f828a48a288d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Acquiring lock "cinder-quobyte-f9213451-2db1-4d48-93d9-05a5cd1bc9ed" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fe6d1284-bb8c-4ca1-a655-f828a48a288d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "cinder-quobyte-f9213451-2db1-4d48-93d9-05a5cd1bc9ed" acquired by "delete_volume" :: waited 0.025s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:09 devstack sudo[113898]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04" returned: 1 in 0.833s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:27:09 devstack cinder-volume[93497]: DEBUG cinder.volume.volume_utils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Downloaded image c2f56963-c5ec-47f4-a61b-d219dfee2fa7 ((None, [{'url': 'file:///opt/stack/data/glance/images/c2f56963-c5ec-47f4-a61b-d219dfee2fa7', 'metadata': {}}])) to volume ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04 successfully. {{(pid=93497) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 29 11:27:09 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Temporary image c2f56963-c5ec-47f4-a61b-d219dfee2fa7 for user 6d3bb171e2c744369a8ca54ee1aa1cd6 is deleted. {{(pid=93497) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 29 11:27:09 devstack cinder-volume[93497]: DEBUG cinder.volume.volume_utils [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Marking volume ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04 as bootable. {{(pid=93497) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 29 11:27:09 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Copying metadata from image c2f56963-c5ec-47f4-a61b-d219dfee2fa7 to ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04. {{(pid=93497) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 29 11:27:09 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Creating volume glance metadata for volume ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04 backed by image c2f56963-c5ec-47f4-a61b-d219dfee2fa7 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c2f56963-c5ec-47f4-a61b-d219dfee2fa7', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '16c592d17c52ae7eb14b6902baffe9ce', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93497) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 29 11:27:09 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[598596e2-964f-4283-84e1-fd2115b30e22]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fe6d1284-bb8c-4ca1-a655-f828a48a288d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f9213451-2db1-4d48-93d9-05a5cd1bc9ed {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:10 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba51e346-c8c4-4d29-b035-25ac2be58448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04', 'volume_size': 1, 'image_id': 'c2f56963-c5ec-47f4-a61b-d219dfee2fa7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c2f56963-c5ec-47f4-a61b-d219dfee2fa7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '16c592d17c52ae7eb14b6902baffe9ce', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '57d8bc61e5784a689d548c0f71262ef9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4fd1a3c402cf5374ecce2990056b6d41e9472cf2d0e6220911867c87496dce14cacc14297be1a286475e08a753177faeef7fcf58856535d017143978cd50497b', 'id': 'c2f56963-c5ec-47f4-a61b-d219dfee2fa7', 'created_at': datetime.datetime(2026, 6, 29, 9, 26, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 9, 26, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c2f56963-c5ec-47f4-a61b-d219dfee2fa7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:10 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c6dd3b-df08-4d7e-8897-a9509b49c3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:10 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Volume volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04 (ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04): created successfully Jun 29 11:27:10 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c6dd3b-df08-4d7e-8897-a9509b49c3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:10 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Flow 'volume_create_manager' (d70902af-809f-4599-ad3b-fd32e3e2c8b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:27:10 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-7e560c8f-d9c0-46d2-ae76-392e6c15c022 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Created volume successfully. Jun 29 11:27:10 devstack sudo[113906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f9213451-2db1-4d48-93d9-05a5cd1bc9ed Jun 29 11:27:10 devstack sudo[113906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-71520ce6-f050-429d-bc01-6409a444b106 tempest-VolumeDependencyTests-932768818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-71520ce6-f050-429d-bc01-6409a444b106 tempest-VolumeDependencyTests-932768818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:10 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-71520ce6-f050-429d-bc01-6409a444b106 tempest-VolumeDependencyTests-932768818 None] Creating offline snapshot 46184545-c73e-4c94-824b-403cf943178f of volume 0a42d51e-620a-44d6-854c-a7716b83f578 {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:27:10 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[4152106d-29fd-4823-b205-0d3cb7aa60e1]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-71520ce6-f050-429d-bc01-6409a444b106 tempest-VolumeDependencyTests-932768818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:10 devstack sudo[113908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578 Jun 29 11:27:10 devstack sudo[113908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:10 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a96077f3-b318-4f3c-a5b0-717bacb125d9 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Acquiring lock "cinder-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:10 devstack sudo[113902]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2a90415f-01f2-4882-bc36-87716f342c5f tempest-VolumeImageDependencyTests-1012582363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13" returned: 0 in 0.871s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2a90415f-01f2-4882-bc36-87716f342c5f tempest-VolumeImageDependencyTests-1012582363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:10 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a96077f3-b318-4f3c-a5b0-717bacb125d9 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Lock "cinder-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:10 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a96077f3-b318-4f3c-a5b0-717bacb125d9 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Acquiring lock "cinder-quobyte-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:10 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a96077f3-b318-4f3c-a5b0-717bacb125d9 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Lock "cinder-quobyte-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04" acquired by "delete_volume" :: waited 0.024s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:10 devstack sudo[113912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13 Jun 29 11:27:10 devstack sudo[113912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:10 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3509dcb2-d369-471d-b3a5-6773f6f688e9]: (4, 'raw') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a96077f3-b318-4f3c-a5b0-717bacb125d9 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:10 devstack sudo[113906]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fe6d1284-bb8c-4ca1-a655-f828a48a288d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f9213451-2db1-4d48-93d9-05a5cd1bc9ed" returned: 0 in 0.933s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fe6d1284-bb8c-4ca1-a655-f828a48a288d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f9213451-2db1-4d48-93d9-05a5cd1bc9ed {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:10 devstack sudo[113918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f9213451-2db1-4d48-93d9-05a5cd1bc9ed Jun 29 11:27:10 devstack sudo[113917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04 Jun 29 11:27:10 devstack sudo[113918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:10 devstack sudo[113917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:11 devstack sudo[113908]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-71520ce6-f050-429d-bc01-6409a444b106 tempest-VolumeDependencyTests-932768818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578" returned: 0 in 0.919s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-71520ce6-f050-429d-bc01-6409a444b106 tempest-VolumeDependencyTests-932768818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578.46184545-c73e-4c94-824b-403cf943178f 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:11 devstack sudo[113925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578.46184545-c73e-4c94-824b-403cf943178f 1G Jun 29 11:27:11 devstack sudo[113925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:11 devstack sudo[113912]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2a90415f-01f2-4882-bc36-87716f342c5f tempest-VolumeImageDependencyTests-1012582363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13" returned: 1 in 0.873s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2a90415f-01f2-4882-bc36-87716f342c5f tempest-VolumeImageDependencyTests-1012582363 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:27:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2a90415f-01f2-4882-bc36-87716f342c5f tempest-VolumeImageDependencyTests-1012582363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:11 devstack sudo[113930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13 Jun 29 11:27:11 devstack sudo[113930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:11 devstack sudo[113918]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fe6d1284-bb8c-4ca1-a655-f828a48a288d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-f9213451-2db1-4d48-93d9-05a5cd1bc9ed" returned: 0 in 0.766s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:11 devstack sudo[113917]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a96077f3-b318-4f3c-a5b0-717bacb125d9 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04" returned: 0 in 0.848s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a96077f3-b318-4f3c-a5b0-717bacb125d9 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:11 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fe6d1284-bb8c-4ca1-a655-f828a48a288d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "cinder-quobyte-f9213451-2db1-4d48-93d9-05a5cd1bc9ed" released by "delete_volume" :: held 1.785s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:11 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-fe6d1284-bb8c-4ca1-a655-f828a48a288d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Created reservations ['c4234c7d-ebf2-4187-a018-3baf75ea2007', '1e870914-6993-4736-bedd-001cd9d504c8', '3a26f6b6-125b-4e74-8860-2cd0deda9ea5', '5263505c-f367-4139-814b-50500b5b87d2'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:27:11 devstack sudo[113935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04 Jun 29 11:27:11 devstack sudo[113935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fe6d1284-bb8c-4ca1-a655-f828a48a288d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fe6d1284-bb8c-4ca1-a655-f828a48a288d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:11 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-fe6d1284-bb8c-4ca1-a655-f828a48a288d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:27:11 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-fe6d1284-bb8c-4ca1-a655-f828a48a288d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:27:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-fe6d1284-bb8c-4ca1-a655-f828a48a288d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fe6d1284-bb8c-4ca1-a655-f828a48a288d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:11 devstack sudo[113940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:27:11 devstack sudo[113940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:12 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-58506fc7-301a-4d99-adb3-2f52598ff91d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Acquiring lock "cinder-5d568413-2ee4-4459-9877-8416a480e8f1-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:12 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-58506fc7-301a-4d99-adb3-2f52598ff91d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "cinder-5d568413-2ee4-4459-9877-8416a480e8f1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:12 devstack sudo[113925]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-71520ce6-f050-429d-bc01-6409a444b106 tempest-VolumeDependencyTests-932768818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578.46184545-c73e-4c94-824b-403cf943178f 1G" returned: 0 in 1.061s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-71520ce6-f050-429d-bc01-6409a444b106 tempest-VolumeDependencyTests-932768818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a42d51e-620a-44d6-854c-a7716b83f578 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578.46184545-c73e-4c94-824b-403cf943178f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:12 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-58506fc7-301a-4d99-adb3-2f52598ff91d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Acquiring lock "cinder-quobyte-5d568413-2ee4-4459-9877-8416a480e8f1" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:12 devstack sudo[113943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a42d51e-620a-44d6-854c-a7716b83f578 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578.46184545-c73e-4c94-824b-403cf943178f Jun 29 11:27:12 devstack sudo[113943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:12 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-58506fc7-301a-4d99-adb3-2f52598ff91d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "cinder-quobyte-5d568413-2ee4-4459-9877-8416a480e8f1" acquired by "delete_volume" :: waited 0.036s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:12 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db4ac5d-73df-4140-8e73-3b3f3df33070]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-58506fc7-301a-4d99-adb3-2f52598ff91d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5d568413-2ee4-4459-9877-8416a480e8f1 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:12 devstack sudo[113930]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2a90415f-01f2-4882-bc36-87716f342c5f tempest-VolumeImageDependencyTests-1012582363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13" returned: 0 in 0.953s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:12 devstack sudo[113946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5d568413-2ee4-4459-9877-8416a480e8f1 Jun 29 11:27:12 devstack sudo[113946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:12 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2a90415f-01f2-4882-bc36-87716f342c5f tempest-VolumeImageDependencyTests-1012582363 None] Lock "cinder-quobyte-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13" released by "delete_volume" :: held 2.777s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:12 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-2a90415f-01f2-4882-bc36-87716f342c5f tempest-VolumeImageDependencyTests-1012582363 None] Created reservations ['f8ef2708-4433-4b7d-8339-de3ac421ee22', '81053f92-5847-477b-af05-3fb2a3797500', '90ae6d76-ca45-4c1f-9451-2a789ee7badd', '6ce5c52c-c661-406e-8645-ca5270036dfa'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:27:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2a90415f-01f2-4882-bc36-87716f342c5f tempest-VolumeImageDependencyTests-1012582363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2a90415f-01f2-4882-bc36-87716f342c5f tempest-VolumeImageDependencyTests-1012582363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:12 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2a90415f-01f2-4882-bc36-87716f342c5f tempest-VolumeImageDependencyTests-1012582363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:27:12 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2a90415f-01f2-4882-bc36-87716f342c5f tempest-VolumeImageDependencyTests-1012582363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:27:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2a90415f-01f2-4882-bc36-87716f342c5f tempest-VolumeImageDependencyTests-1012582363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2a90415f-01f2-4882-bc36-87716f342c5f tempest-VolumeImageDependencyTests-1012582363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:12 devstack sudo[113935]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a96077f3-b318-4f3c-a5b0-717bacb125d9 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04" returned: 1 in 0.949s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a96077f3-b318-4f3c-a5b0-717bacb125d9 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04' failed. Not Retrying. {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 11:27:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a96077f3-b318-4f3c-a5b0-717bacb125d9 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:12 devstack sudo[113952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04 Jun 29 11:27:12 devstack sudo[113952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:12 devstack sudo[113951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:27:12 devstack sudo[113951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:12 devstack sudo[113940]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-fe6d1284-bb8c-4ca1-a655-f828a48a288d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.113s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:13 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-fe6d1284-bb8c-4ca1-a655-f828a48a288d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:27:13 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-fe6d1284-bb8c-4ca1-a655-f828a48a288d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Deleted volume successfully. Jun 29 11:27:13 devstack sudo[113943]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-71520ce6-f050-429d-bc01-6409a444b106 tempest-VolumeDependencyTests-932768818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a42d51e-620a-44d6-854c-a7716b83f578 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578.46184545-c73e-4c94-824b-403cf943178f" returned: 0 in 0.855s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:13 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-71520ce6-f050-429d-bc01-6409a444b106 tempest-VolumeDependencyTests-932768818 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578.46184545-c73e-4c94-824b-403cf943178f is being set with open permissions: ugo+rw Jun 29 11:27:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-71520ce6-f050-429d-bc01-6409a444b106 tempest-VolumeDependencyTests-932768818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578.46184545-c73e-4c94-824b-403cf943178f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:13 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-fe6d1284-bb8c-4ca1-a655-f828a48a288d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "cinder-f9213451-2db1-4d48-93d9-05a5cd1bc9ed-delete_volume" released by "delete_volume" :: held 3.274s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:13 devstack sudo[113959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578.46184545-c73e-4c94-824b-403cf943178f Jun 29 11:27:13 devstack sudo[113959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:13 devstack sudo[113946]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-58506fc7-301a-4d99-adb3-2f52598ff91d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5d568413-2ee4-4459-9877-8416a480e8f1" returned: 0 in 1.137s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-58506fc7-301a-4d99-adb3-2f52598ff91d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5d568413-2ee4-4459-9877-8416a480e8f1 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:13 devstack sudo[113965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5d568413-2ee4-4459-9877-8416a480e8f1 Jun 29 11:27:13 devstack sudo[113965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:13 devstack sudo[113952]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a96077f3-b318-4f3c-a5b0-717bacb125d9 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04" returned: 0 in 0.884s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:13 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a96077f3-b318-4f3c-a5b0-717bacb125d9 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Lock "cinder-quobyte-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04" released by "delete_volume" :: held 2.758s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:13 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-a96077f3-b318-4f3c-a5b0-717bacb125d9 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Created reservations ['ec9352f6-8a99-4411-a08d-57aad1e16d69', '7c579204-ddf3-488a-b9c1-98237a076558', '56c05c45-0516-44db-860b-a0b86c5a40fe', 'c334abc5-2baf-4c3c-b20e-6c39fa569541'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:27:13 devstack sudo[113951]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a96077f3-b318-4f3c-a5b0-717bacb125d9 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a96077f3-b318-4f3c-a5b0-717bacb125d9 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:13 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a96077f3-b318-4f3c-a5b0-717bacb125d9 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:27:13 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a96077f3-b318-4f3c-a5b0-717bacb125d9 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:27:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a96077f3-b318-4f3c-a5b0-717bacb125d9 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a96077f3-b318-4f3c-a5b0-717bacb125d9 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2a90415f-01f2-4882-bc36-87716f342c5f tempest-VolumeImageDependencyTests-1012582363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.179s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:13 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-2a90415f-01f2-4882-bc36-87716f342c5f tempest-VolumeImageDependencyTests-1012582363 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:27:13 devstack sudo[113969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:27:13 devstack sudo[113969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:13 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-2a90415f-01f2-4882-bc36-87716f342c5f tempest-VolumeImageDependencyTests-1012582363 None] Deleted volume successfully. Jun 29 11:27:13 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-2a90415f-01f2-4882-bc36-87716f342c5f tempest-VolumeImageDependencyTests-1012582363 None] Lock "cinder-4f7a97e0-c685-409c-9d3a-40dbdbb6fd13-delete_volume" released by "delete_volume" :: held 4.301s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:13 devstack sudo[113959]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-71520ce6-f050-429d-bc01-6409a444b106 tempest-VolumeDependencyTests-932768818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578.46184545-c73e-4c94-824b-403cf943178f" returned: 0 in 0.934s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-71520ce6-f050-429d-bc01-6409a444b106 tempest-VolumeDependencyTests-932768818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:14 devstack sudo[113971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578.info Jun 29 11:27:14 devstack sudo[113971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:14 devstack sudo[113965]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-58506fc7-301a-4d99-adb3-2f52598ff91d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5d568413-2ee4-4459-9877-8416a480e8f1" returned: 0 in 0.910s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:14 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-58506fc7-301a-4d99-adb3-2f52598ff91d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "cinder-quobyte-5d568413-2ee4-4459-9877-8416a480e8f1" released by "delete_volume" :: held 2.123s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:14 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-58506fc7-301a-4d99-adb3-2f52598ff91d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Created reservations ['fcf4060f-2076-4b91-b4a6-cb995c8749a5', '9262bca4-105c-489a-9838-90242af2d4be', 'f215c8b0-61d5-4b57-836b-2f44ec1080bc', 'b6723217-07ec-4a65-80af-3d78707b8dc6'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:27:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-58506fc7-301a-4d99-adb3-2f52598ff91d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-58506fc7-301a-4d99-adb3-2f52598ff91d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:14 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-58506fc7-301a-4d99-adb3-2f52598ff91d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:27:14 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-58506fc7-301a-4d99-adb3-2f52598ff91d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:27:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-58506fc7-301a-4d99-adb3-2f52598ff91d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-58506fc7-301a-4d99-adb3-2f52598ff91d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:14 devstack sudo[113974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:27:14 devstack sudo[113974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:14 devstack sudo[113969]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a96077f3-b318-4f3c-a5b0-717bacb125d9 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.060s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:14 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-a96077f3-b318-4f3c-a5b0-717bacb125d9 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:27:14 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-a96077f3-b318-4f3c-a5b0-717bacb125d9 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Deleted volume successfully. Jun 29 11:27:14 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a96077f3-b318-4f3c-a5b0-717bacb125d9 tempest-VolumeAndVolumeTypeFromImageTest-782367222 None] Lock "cinder-ba443fb7-c0f2-423e-bdb3-5ee3cdd51c04-delete_volume" released by "delete_volume" :: held 4.194s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:15 devstack sudo[113971]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-71520ce6-f050-429d-bc01-6409a444b106 tempest-VolumeDependencyTests-932768818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578.info" returned: 0 in 1.026s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:15 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-71520ce6-f050-429d-bc01-6409a444b106 tempest-VolumeDependencyTests-932768818 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578.info is being set with open permissions: ugo+rw Jun 29 11:27:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-71520ce6-f050-429d-bc01-6409a444b106 tempest-VolumeDependencyTests-932768818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:15 devstack sudo[113978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578.info Jun 29 11:27:15 devstack sudo[113978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:15 devstack sudo[113974]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-58506fc7-301a-4d99-adb3-2f52598ff91d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.761s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:15 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-58506fc7-301a-4d99-adb3-2f52598ff91d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:27:15 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-58506fc7-301a-4d99-adb3-2f52598ff91d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Deleted volume successfully. Jun 29 11:27:15 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-58506fc7-301a-4d99-adb3-2f52598ff91d tempest-CreateVolumesFromSourceVolumeTest-374288398 None] Lock "cinder-5d568413-2ee4-4459-9877-8416a480e8f1-delete_volume" released by "delete_volume" :: held 3.293s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:15 devstack sudo[113978]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-71520ce6-f050-429d-bc01-6409a444b106 tempest-VolumeDependencyTests-932768818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578.info" returned: 0 in 0.905s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-71520ce6-f050-429d-bc01-6409a444b106 tempest-VolumeDependencyTests-932768818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.834s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:16 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-71520ce6-f050-429d-bc01-6409a444b106 tempest-VolumeDependencyTests-932768818 None] Create snapshot completed successfully Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Flow 'volume_create_manager' (f74808e4-7835-425d-a0b5-6eacdd297649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad660a0-e3b9-4380-a074-caca6d17e7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad660a0-e3b9-4380-a074-caca6d17e7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-355186053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b41de2-9c7c-407d-b602-9ee7ae7d663d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f346dcbb09a4bc4bb47d10541e2ec7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=46184545-c73e-4c94-824b-403cf943178f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:27:17Z,use_quota=True,user_id='13ca08e1ce504ca296ff27da763c2f6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93154bd0-e240-441b-8075-21f8ac80c17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93154bd0-e240-441b-8075-21f8ac80c17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b10897e5-fe38-442b-98c2-c8744cca099f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b10897e5-fe38-442b-98c2-c8744cca099f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd3b41de2-9c7c-407d-b602-9ee7ae7d663d', 'volume_name': 'volume-d3b41de2-9c7c-407d-b602-9ee7ae7d663d', 'volume_size': 1, 'snapshot_id': '46184545-c73e-4c94-824b-403cf943178f'}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d332b9-5d43-4f6c-ab84-f007e04b7f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d332b9-5d43-4f6c-ab84-f007e04b7f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199d9eab-f766-4abf-8946-790290c3c379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:17 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Volume d3b41de2-9c7c-407d-b602-9ee7ae7d663d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d3b41de2-9c7c-407d-b602-9ee7ae7d663d', 'volume_size': 1, 'snapshot_id': '46184545-c73e-4c94-824b-403cf943178f'} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Acquiring lock "cinder-quobyte-46184545-c73e-4c94-824b-403cf943178f-d3b41de2-9c7c-407d-b602-9ee7ae7d663d" by "_create_volume_from_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Lock "cinder-quobyte-46184545-c73e-4c94-824b-403cf943178f-d3b41de2-9c7c-407d-b602-9ee7ae7d663d" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Creating volume d3b41de2-9c7c-407d-b602-9ee7ae7d663d from snapshot 46184545-c73e-4c94-824b-403cf943178f {{(pid=93497) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Acquiring lock "cinder-quobyte-d3b41de2-9c7c-407d-b602-9ee7ae7d663d" by "_copy_volume_from_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Lock "cinder-quobyte-d3b41de2-9c7c-407d-b602-9ee7ae7d663d" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] snapshot: 46184545-c73e-4c94-824b-403cf943178f, volume: d3b41de2-9c7c-407d-b602-9ee7ae7d663d, {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd355f6-0d9b-4a22-a249-cde5549af585]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578.46184545-c73e-4c94-824b-403cf943178f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:17 devstack sudo[113983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578.46184545-c73e-4c94-824b-403cf943178f Jun 29 11:27:17 devstack sudo[113983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:18 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:27:18 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] Flow 'volume_create_manager' (ef127b87-8de1-4568-bb00-0ea8f72b829d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:27:18 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb423e1-4fe6-4663-ae38-a758c2767497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:18 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb423e1-4fe6-4663-ae38-a758c2767497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=575590bb-3668-4288-bda9-b24818eea871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85928c194fc4f089c5375454b18d75b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:27:18Z,use_quota=True,user_id='016a368a3edc4f9ca06ec59b2157dfe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:18 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23880ade-17da-4dbd-947a-83025619caf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:18 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23880ade-17da-4dbd-947a-83025619caf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:18 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7536bbb-edd3-413a-a3db-4fc357b7b216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:18 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7536bbb-edd3-413a-a3db-4fc357b7b216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '575590bb-3668-4288-bda9-b24818eea871', 'volume_name': 'volume-575590bb-3668-4288-bda9-b24818eea871', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:18 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d6e6fe-f410-47f6-822c-68313fdf9db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:18 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d6e6fe-f410-47f6-822c-68313fdf9db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:18 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1297d62-6d96-41b8-82e2-63706909c379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:18 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] Volume 575590bb-3668-4288-bda9-b24818eea871: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-575590bb-3668-4288-bda9-b24818eea871', 'volume_size': 1} Jun 29 11:27:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:18 devstack sudo[113983]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578.46184545-c73e-4c94-824b-403cf943178f" returned: 0 in 0.998s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:18 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a42d51e-620a-44d6-854c-a7716b83f578(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:27:18 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578 {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 11:27:18 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Creating direct copy from snapshot {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 11:27:18 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13a0d85-06c9-49eb-a3dc-89c67598249d]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:18 devstack sudo[113993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578 Jun 29 11:27:18 devstack sudo[113993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:19 devstack sudo[113993]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578" returned: 0 in 0.878s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:19 devstack cinder-volume[93497]: DEBUG cinder.utils [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Path /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d3b41de2-9c7c-407d-b602-9ee7ae7d663d not found in is_blk_device check {{(pid=93497) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 11:27:19 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d3b41de2-9c7c-407d-b602-9ee7ae7d663d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:19 devstack sudo[114001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d3b41de2-9c7c-407d-b602-9ee7ae7d663d Jun 29 11:27:19 devstack sudo[114001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:20 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:27:20 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Flow 'volume_create_manager' (d767eff0-98dc-4f55-8349-21e05b17c24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:27:20 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07030d23-304f-425a-b41f-93aa0f2b31c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:20 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07030d23-304f-425a-b41f-93aa0f2b31c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1814045291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ac6780-1a95-4c4a-b389-0018adbb3db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97318f170b354c15850eeed38554dbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:27:20Z,use_quota=True,user_id='a15ad32b5b2f48aa91eb9c0eadd4b277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:20 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2589464e-f7bf-42f7-b8c0-a860dc477fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:20 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2589464e-f7bf-42f7-b8c0-a860dc477fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:20 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17452c7-9c65-461c-8418-9cd82fb759f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:20 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17452c7-9c65-461c-8418-9cd82fb759f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41ac6780-1a95-4c4a-b389-0018adbb3db4', 'volume_name': 'volume-41ac6780-1a95-4c4a-b389-0018adbb3db4', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:20 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c70c936c-3d55-4756-98db-7ba0398a3b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:20 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c70c936c-3d55-4756-98db-7ba0398a3b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:20 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9abaf4da-22fa-4a69-aa79-9024a639bff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:20 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Volume 41ac6780-1a95-4c4a-b389-0018adbb3db4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41ac6780-1a95-4c4a-b389-0018adbb3db4', 'volume_size': 1} Jun 29 11:27:20 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:25 devstack sudo[114001]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d3b41de2-9c7c-407d-b602-9ee7ae7d663d" returned: 0 in 5.465s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:25 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efc013b-8674-4321-9ff3-6cc3fc01fe26]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:25 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:25 devstack sudo[114014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578 Jun 29 11:27:25 devstack sudo[114014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:26 devstack sudo[114014]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578" returned: 0 in 0.973s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:26 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Image conversion details: src /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578, size 1024.00 MB, duration 5.47 sec, destination /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d3b41de2-9c7c-407d-b602-9ee7ae7d663d {{(pid=93497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 11:27:26 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Converted 1024.00 MB image at 187.31 MB/s Jun 29 11:27:26 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d3b41de2-9c7c-407d-b602-9ee7ae7d663d is being set with open permissions: ugo+rw Jun 29 11:27:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d3b41de2-9c7c-407d-b602-9ee7ae7d663d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:26 devstack sudo[114020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d3b41de2-9c7c-407d-b602-9ee7ae7d663d Jun 29 11:27:26 devstack sudo[114020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:26 devstack sudo[114020]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d3b41de2-9c7c-407d-b602-9ee7ae7d663d" returned: 0 in 0.745s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:26 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Lock "cinder-quobyte-d3b41de2-9c7c-407d-b602-9ee7ae7d663d" released by "_copy_volume_from_snapshot" :: held 9.178s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:26 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Lock "cinder-quobyte-46184545-c73e-4c94-824b-403cf943178f-d3b41de2-9c7c-407d-b602-9ee7ae7d663d" released by "_create_volume_from_snapshot" :: held 9.216s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.235s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.556s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:26 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=575590bb-3668-4288-bda9-b24818eea871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85928c194fc4f089c5375454b18d75b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:27:18Z,use_quota=True,user_id='016a368a3edc4f9ca06ec59b2157dfe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:27:26 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] Creating volume 575590bb-3668-4288-bda9-b24818eea871 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:27:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:26 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:27:26 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:27:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:26 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:27:26 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:27:26 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-575590bb-3668-4288-bda9-b24818eea871 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:26 devstack sudo[114023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-575590bb-3668-4288-bda9-b24818eea871 1073741824 Jun 29 11:27:26 devstack sudo[114023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:26 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199d9eab-f766-4abf-8946-790290c3c379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3b41de2-9c7c-407d-b602-9ee7ae7d663d', 'volume_size': 1, 'snapshot_id': '46184545-c73e-4c94-824b-403cf943178f'}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:26 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f12dd0-e0ec-4610-b900-5c9f8ad3f30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:26 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Volume volume-d3b41de2-9c7c-407d-b602-9ee7ae7d663d (d3b41de2-9c7c-407d-b602-9ee7ae7d663d): created successfully Jun 29 11:27:26 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f12dd0-e0ec-4610-b900-5c9f8ad3f30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:26 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Flow 'volume_create_manager' (f74808e4-7835-425d-a0b5-6eacdd297649) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:27:26 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-003f8506-1cb3-48d3-ae8b-004706d54df8 tempest-VolumeDependencyTests-932768818 None] Created volume successfully. Jun 29 11:27:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-32439e0a-ec88-4d2f-bcf9-6bcfa673c95d tempest-VolumeDependencyTests-932768818 None] Acquiring lock "cinder-46184545-c73e-4c94-824b-403cf943178f-delete_snapshot" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-32439e0a-ec88-4d2f-bcf9-6bcfa673c95d tempest-VolumeDependencyTests-932768818 None] Lock "cinder-46184545-c73e-4c94-824b-403cf943178f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-32439e0a-ec88-4d2f-bcf9-6bcfa673c95d tempest-VolumeDependencyTests-932768818 None] Acquiring lock "cinder-quobyte-0a42d51e-620a-44d6-854c-a7716b83f578" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-32439e0a-ec88-4d2f-bcf9-6bcfa673c95d tempest-VolumeDependencyTests-932768818 None] Lock "cinder-quobyte-0a42d51e-620a-44d6-854c-a7716b83f578" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-32439e0a-ec88-4d2f-bcf9-6bcfa673c95d tempest-VolumeDependencyTests-932768818 None] Acquiring lock "cinder-quobyte-46184545-c73e-4c94-824b-403cf943178f" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:27 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-32439e0a-ec88-4d2f-bcf9-6bcfa673c95d tempest-VolumeDependencyTests-932768818 None] Lock "cinder-quobyte-46184545-c73e-4c94-824b-403cf943178f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:27 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-32439e0a-ec88-4d2f-bcf9-6bcfa673c95d tempest-VolumeDependencyTests-932768818 None] Deleting offline snapshot 46184545-c73e-4c94-824b-403cf943178f of volume 0a42d51e-620a-44d6-854c-a7716b83f578 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:27:27 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-32439e0a-ec88-4d2f-bcf9-6bcfa673c95d tempest-VolumeDependencyTests-932768818 None] snapshot_file for this snap is: volume-0a42d51e-620a-44d6-854c-a7716b83f578.46184545-c73e-4c94-824b-403cf943178f {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:27:27 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c9bdcf-7cbb-4a1a-ae4a-2f71845cb05a]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-32439e0a-ec88-4d2f-bcf9-6bcfa673c95d tempest-VolumeDependencyTests-932768818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578.46184545-c73e-4c94-824b-403cf943178f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:27 devstack sudo[114025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578.46184545-c73e-4c94-824b-403cf943178f Jun 29 11:27:27 devstack sudo[114025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:27 devstack sudo[114023]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-575590bb-3668-4288-bda9-b24818eea871 1073741824" returned: 0 in 0.993s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:27 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-575590bb-3668-4288-bda9-b24818eea871 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:27 devstack sudo[114032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-575590bb-3668-4288-bda9-b24818eea871 Jun 29 11:27:27 devstack sudo[114032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:28 devstack sudo[114025]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-32439e0a-ec88-4d2f-bcf9-6bcfa673c95d tempest-VolumeDependencyTests-932768818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578.46184545-c73e-4c94-824b-403cf943178f" returned: 0 in 0.844s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:28 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-32439e0a-ec88-4d2f-bcf9-6bcfa673c95d tempest-VolumeDependencyTests-932768818 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a42d51e-620a-44d6-854c-a7716b83f578(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:27:28 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc15c5e-5852-43c0-8fc2-7a1b4efbe4cb]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-32439e0a-ec88-4d2f-bcf9-6bcfa673c95d tempest-VolumeDependencyTests-932768818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:28 devstack sudo[114038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578 Jun 29 11:27:28 devstack sudo[114038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:28 devstack sudo[114032]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-575590bb-3668-4288-bda9-b24818eea871" returned: 0 in 0.701s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:28 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:27:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.062s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:28 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1814045291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ac6780-1a95-4c4a-b389-0018adbb3db4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97318f170b354c15850eeed38554dbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:27:20Z,use_quota=True,user_id='a15ad32b5b2f48aa91eb9c0eadd4b277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:27:28 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Creating volume 41ac6780-1a95-4c4a-b389-0018adbb3db4 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:27:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:28 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:27:28 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:27:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:28 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:27:28 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:27:28 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:28 devstack sudo[114041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4 1073741824 Jun 29 11:27:28 devstack sudo[114041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:28 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1297d62-6d96-41b8-82e2-63706909c379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-575590bb-3668-4288-bda9-b24818eea871', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:28 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e0b15f-2fb5-472f-b3f1-079fa55a5e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:28 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] Volume volume-575590bb-3668-4288-bda9-b24818eea871 (575590bb-3668-4288-bda9-b24818eea871): created successfully Jun 29 11:27:28 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e0b15f-2fb5-472f-b3f1-079fa55a5e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:28 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] Flow 'volume_create_manager' (ef127b87-8de1-4568-bb00-0ea8f72b829d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:27:28 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-7aac9323-af06-408d-9dfa-ea59f57b7ae0 tempest-CinderUnicodeTest-1032737541 None] Created volume successfully. Jun 29 11:27:29 devstack sudo[114038]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-32439e0a-ec88-4d2f-bcf9-6bcfa673c95d tempest-VolumeDependencyTests-932768818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578" returned: 0 in 0.852s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-32439e0a-ec88-4d2f-bcf9-6bcfa673c95d tempest-VolumeDependencyTests-932768818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578.46184545-c73e-4c94-824b-403cf943178f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:29 devstack sudo[114046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578.46184545-c73e-4c94-824b-403cf943178f Jun 29 11:27:29 devstack sudo[114046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:29 devstack sudo[114041]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4 1073741824" returned: 0 in 1.199s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:29 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:UPDATE=157,cinder:SELECT=107,cinder:INSERT=48,cinder:DELETE=17 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:27:29 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:29 devstack sudo[114055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4 Jun 29 11:27:29 devstack sudo[114055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:29 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] Flow 'volume_create_manager' (c7af4e38-4aaa-4012-9d9a-3c3d6dd0993d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0055cec3-faa3-447a-9af9-c245f5071b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0055cec3-faa3-447a-9af9-c245f5071b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:27:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1214755559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e1a5c05-e41a-4b12-99ce-5dd31961cc6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85928c194fc4f089c5375454b18d75b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:27:30Z,use_quota=True,user_id='016a368a3edc4f9ca06ec59b2157dfe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (901938d6-46a5-4cee-9825-763353dec377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (901938d6-46a5-4cee-9825-763353dec377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3503baac-27e0-4128-946f-6ab6a96d05c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3503baac-27e0-4128-946f-6ab6a96d05c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e1a5c05-e41a-4b12-99ce-5dd31961cc6f', 'volume_name': 'volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (963e8bd6-346c-4f79-b158-01d55ac8d3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (963e8bd6-346c-4f79-b158-01d55ac8d3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdce79fe-3b7f-4fee-a53d-21f0be3917c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:30 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] Volume 5e1a5c05-e41a-4b12-99ce-5dd31961cc6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f', 'volume_size': 1} Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:30 devstack sudo[114046]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-32439e0a-ec88-4d2f-bcf9-6bcfa673c95d tempest-VolumeDependencyTests-932768818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578.46184545-c73e-4c94-824b-403cf943178f" returned: 0 in 1.116s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-32439e0a-ec88-4d2f-bcf9-6bcfa673c95d tempest-VolumeDependencyTests-932768818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578.46184545-c73e-4c94-824b-403cf943178f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:30 devstack sudo[114060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578.46184545-c73e-4c94-824b-403cf943178f Jun 29 11:27:30 devstack sudo[114060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:30 devstack sudo[114055]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4" returned: 0 in 0.767s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] <== create_volume: return (2031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.036s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.504s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:27:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1214755559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e1a5c05-e41a-4b12-99ce-5dd31961cc6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b85928c194fc4f089c5375454b18d75b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:27:30Z,use_quota=True,user_id='016a368a3edc4f9ca06ec59b2157dfe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] Creating volume 5e1a5c05-e41a-4b12-99ce-5dd31961cc6f {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:27:30 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9abaf4da-22fa-4a69-aa79-9024a639bff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41ac6780-1a95-4c4a-b389-0018adbb3db4', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3a34767-4b18-4578-bf5d-bae8cab09c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:30 devstack sudo[114063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f 1073741824 Jun 29 11:27:30 devstack sudo[114063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:30 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Volume volume-41ac6780-1a95-4c4a-b389-0018adbb3db4 (41ac6780-1a95-4c4a-b389-0018adbb3db4): created successfully Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3a34767-4b18-4578-bf5d-bae8cab09c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Flow 'volume_create_manager' (d767eff0-98dc-4f55-8349-21e05b17c24b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:27:30 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=123,cinder:UPDATE=160,cinder:DELETE=13,cinder:INSERT=40 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:27:30 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-4b2ce278-be86-4929-b0d8-f18b2a2835b1 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Created volume successfully. Jun 29 11:27:31 devstack sudo[114060]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-32439e0a-ec88-4d2f-bcf9-6bcfa673c95d tempest-VolumeDependencyTests-932768818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578.46184545-c73e-4c94-824b-403cf943178f" returned: 0 in 0.786s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:31 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-32439e0a-ec88-4d2f-bcf9-6bcfa673c95d tempest-VolumeDependencyTests-932768818 None] Lock "cinder-quobyte-46184545-c73e-4c94-824b-403cf943178f" released by "_delete_snapshot" :: held 3.712s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:31 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-32439e0a-ec88-4d2f-bcf9-6bcfa673c95d tempest-VolumeDependencyTests-932768818 None] Lock "cinder-quobyte-0a42d51e-620a-44d6-854c-a7716b83f578" released by "delete_snapshot" :: held 3.753s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:31 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-32439e0a-ec88-4d2f-bcf9-6bcfa673c95d tempest-VolumeDependencyTests-932768818 None] Created reservations ['9beb4953-c3af-4756-9e37-67706dd9dc93', '88036d88-1f23-450c-b524-ab99770d0da1', 'f3c7db21-0df1-4586-9021-8ffdb221d4de', 'ffeee5ef-af1c-4561-8ad5-7cac2af13124'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:27:31 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-32439e0a-ec88-4d2f-bcf9-6bcfa673c95d tempest-VolumeDependencyTests-932768818 None] Delete snapshot completed successfully. Jun 29 11:27:31 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-32439e0a-ec88-4d2f-bcf9-6bcfa673c95d tempest-VolumeDependencyTests-932768818 None] Lock "cinder-46184545-c73e-4c94-824b-403cf943178f-delete_snapshot" released by "delete_snapshot" :: held 3.917s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:31 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-62843e23-6a43-49eb-8415-03d8bf0c93cc tempest-VolumeDependencyTests-932768818 None] Acquiring lock "cinder-0a42d51e-620a-44d6-854c-a7716b83f578-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:31 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-62843e23-6a43-49eb-8415-03d8bf0c93cc tempest-VolumeDependencyTests-932768818 None] Lock "cinder-0a42d51e-620a-44d6-854c-a7716b83f578-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:31 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-62843e23-6a43-49eb-8415-03d8bf0c93cc tempest-VolumeDependencyTests-932768818 None] Acquiring lock "cinder-quobyte-0a42d51e-620a-44d6-854c-a7716b83f578" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:31 devstack sudo[114063]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f 1073741824" returned: 0 in 1.069s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:31 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-62843e23-6a43-49eb-8415-03d8bf0c93cc tempest-VolumeDependencyTests-932768818 None] Lock "cinder-quobyte-0a42d51e-620a-44d6-854c-a7716b83f578" acquired by "delete_volume" :: waited 0.034s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:31 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1487655c-ce59-4cd9-a460-f5670dd618f7]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-62843e23-6a43-49eb-8415-03d8bf0c93cc tempest-VolumeDependencyTests-932768818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-200735cf-852e-4db1-9aeb-94e047bd3764 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:31 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:31 devstack sudo[114071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f Jun 29 11:27:31 devstack sudo[114071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:31 devstack sudo[114070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578 Jun 29 11:27:31 devstack sudo[114070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:32 devstack sudo[114071]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f" returned: 0 in 0.707s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:32 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:27:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.885s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-200735cf-852e-4db1-9aeb-94e047bd3764 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.715s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:32 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdce79fe-3b7f-4fee-a53d-21f0be3917c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:32 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f02d41-ecab-4050-bd47-9da08fae9f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:32 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-200735cf-852e-4db1-9aeb-94e047bd3764 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Creating offline snapshot 2c036968-783b-47d5-9801-e61fef94eae4 of volume 41ac6780-1a95-4c4a-b389-0018adbb3db4 {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:27:32 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] Volume volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f (5e1a5c05-e41a-4b12-99ce-5dd31961cc6f): created successfully Jun 29 11:27:32 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f02d41-ecab-4050-bd47-9da08fae9f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:32 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] Flow 'volume_create_manager' (c7af4e38-4aaa-4012-9d9a-3c3d6dd0993d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:27:32 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8af1f5-bc9a-4b31-bbd3-e9d18b30e33c]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-200735cf-852e-4db1-9aeb-94e047bd3764 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:32 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-a99901c1-7a9c-43d0-8e95-0cc580f86059 tempest-CinderUnicodeTest-1032737541 None] Created volume successfully. Jun 29 11:27:32 devstack sudo[114070]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-62843e23-6a43-49eb-8415-03d8bf0c93cc tempest-VolumeDependencyTests-932768818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578" returned: 0 in 0.877s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:32 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-62843e23-6a43-49eb-8415-03d8bf0c93cc tempest-VolumeDependencyTests-932768818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:32 devstack sudo[114080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578 Jun 29 11:27:32 devstack sudo[114080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:32 devstack sudo[114079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4 Jun 29 11:27:32 devstack sudo[114079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ed182a78-0598-4d36-8937-675943378b29 tempest-CinderUnicodeTest-1032737541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:33 devstack sudo[114080]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-62843e23-6a43-49eb-8415-03d8bf0c93cc tempest-VolumeDependencyTests-932768818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0a42d51e-620a-44d6-854c-a7716b83f578" returned: 0 in 0.862s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:33 devstack sudo[114079]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-200735cf-852e-4db1-9aeb-94e047bd3764 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4" returned: 0 in 0.954s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-200735cf-852e-4db1-9aeb-94e047bd3764 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4.2c036968-783b-47d5-9801-e61fef94eae4 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:33 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-62843e23-6a43-49eb-8415-03d8bf0c93cc tempest-VolumeDependencyTests-932768818 None] Lock "cinder-quobyte-0a42d51e-620a-44d6-854c-a7716b83f578" released by "delete_volume" :: held 1.836s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:33 devstack sudo[114087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4.2c036968-783b-47d5-9801-e61fef94eae4 1G Jun 29 11:27:33 devstack sudo[114087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:33 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-62843e23-6a43-49eb-8415-03d8bf0c93cc tempest-VolumeDependencyTests-932768818 None] Created reservations ['4072476f-9476-456c-be6e-dd827de6af70', 'e58efd41-dfc8-48de-89e6-1f0c30c24868', '4394cbaf-7847-4547-8cf2-9410ff831f80', '00b87dd9-5c46-4f91-b3d1-8e35da2538bd'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:27:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-62843e23-6a43-49eb-8415-03d8bf0c93cc tempest-VolumeDependencyTests-932768818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-62843e23-6a43-49eb-8415-03d8bf0c93cc tempest-VolumeDependencyTests-932768818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:33 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-62843e23-6a43-49eb-8415-03d8bf0c93cc tempest-VolumeDependencyTests-932768818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:27:33 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-62843e23-6a43-49eb-8415-03d8bf0c93cc tempest-VolumeDependencyTests-932768818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:27:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-62843e23-6a43-49eb-8415-03d8bf0c93cc tempest-VolumeDependencyTests-932768818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:33 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-62843e23-6a43-49eb-8415-03d8bf0c93cc tempest-VolumeDependencyTests-932768818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:33 devstack sudo[114089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:27:33 devstack sudo[114089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:33 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-eeb5f217-3f7a-496d-9331-e90d5cd39683 tempest-VolumeDependencyTests-932768818 None] Acquiring lock "cinder-d3b41de2-9c7c-407d-b602-9ee7ae7d663d-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:33 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-eeb5f217-3f7a-496d-9331-e90d5cd39683 tempest-VolumeDependencyTests-932768818 None] Lock "cinder-d3b41de2-9c7c-407d-b602-9ee7ae7d663d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:34 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-eeb5f217-3f7a-496d-9331-e90d5cd39683 tempest-VolumeDependencyTests-932768818 None] Acquiring lock "cinder-quobyte-d3b41de2-9c7c-407d-b602-9ee7ae7d663d" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:34 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-eeb5f217-3f7a-496d-9331-e90d5cd39683 tempest-VolumeDependencyTests-932768818 None] Lock "cinder-quobyte-d3b41de2-9c7c-407d-b602-9ee7ae7d663d" acquired by "delete_volume" :: waited 0.026s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:34 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c44e05-41f1-4f5f-9e64-f96611e059ae]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-eeb5f217-3f7a-496d-9331-e90d5cd39683 tempest-VolumeDependencyTests-932768818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d3b41de2-9c7c-407d-b602-9ee7ae7d663d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:34 devstack sudo[114091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d3b41de2-9c7c-407d-b602-9ee7ae7d663d Jun 29 11:27:34 devstack sudo[114091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:34 devstack sudo[114089]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-62843e23-6a43-49eb-8415-03d8bf0c93cc tempest-VolumeDependencyTests-932768818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.807s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:34 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-62843e23-6a43-49eb-8415-03d8bf0c93cc tempest-VolumeDependencyTests-932768818 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:27:34 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-62843e23-6a43-49eb-8415-03d8bf0c93cc tempest-VolumeDependencyTests-932768818 None] Deleted volume successfully. Jun 29 11:27:34 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-62843e23-6a43-49eb-8415-03d8bf0c93cc tempest-VolumeDependencyTests-932768818 None] Lock "cinder-0a42d51e-620a-44d6-854c-a7716b83f578-delete_volume" released by "delete_volume" :: held 3.005s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:34 devstack sudo[114087]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-200735cf-852e-4db1-9aeb-94e047bd3764 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4.2c036968-783b-47d5-9801-e61fef94eae4 1G" returned: 0 in 1.215s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:34 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-200735cf-852e-4db1-9aeb-94e047bd3764 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41ac6780-1a95-4c4a-b389-0018adbb3db4 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4.2c036968-783b-47d5-9801-e61fef94eae4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:34 devstack sudo[114098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41ac6780-1a95-4c4a-b389-0018adbb3db4 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4.2c036968-783b-47d5-9801-e61fef94eae4 Jun 29 11:27:34 devstack sudo[114098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:35 devstack sudo[114091]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-eeb5f217-3f7a-496d-9331-e90d5cd39683 tempest-VolumeDependencyTests-932768818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d3b41de2-9c7c-407d-b602-9ee7ae7d663d" returned: 0 in 0.967s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-eeb5f217-3f7a-496d-9331-e90d5cd39683 tempest-VolumeDependencyTests-932768818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d3b41de2-9c7c-407d-b602-9ee7ae7d663d {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:35 devstack sudo[114103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d3b41de2-9c7c-407d-b602-9ee7ae7d663d Jun 29 11:27:35 devstack sudo[114103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:35 devstack sudo[114098]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-200735cf-852e-4db1-9aeb-94e047bd3764 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41ac6780-1a95-4c4a-b389-0018adbb3db4 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4.2c036968-783b-47d5-9801-e61fef94eae4" returned: 0 in 0.789s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:35 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-200735cf-852e-4db1-9aeb-94e047bd3764 tempest-CreateVolumesFromSnapshotTest-1253550899 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4.2c036968-783b-47d5-9801-e61fef94eae4 is being set with open permissions: ugo+rw Jun 29 11:27:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-200735cf-852e-4db1-9aeb-94e047bd3764 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4.2c036968-783b-47d5-9801-e61fef94eae4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:35 devstack sudo[114108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4.2c036968-783b-47d5-9801-e61fef94eae4 Jun 29 11:27:35 devstack sudo[114108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:35 devstack sudo[114103]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-eeb5f217-3f7a-496d-9331-e90d5cd39683 tempest-VolumeDependencyTests-932768818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-d3b41de2-9c7c-407d-b602-9ee7ae7d663d" returned: 0 in 0.789s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:35 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-eeb5f217-3f7a-496d-9331-e90d5cd39683 tempest-VolumeDependencyTests-932768818 None] Lock "cinder-quobyte-d3b41de2-9c7c-407d-b602-9ee7ae7d663d" released by "delete_volume" :: held 1.811s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:35 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-eeb5f217-3f7a-496d-9331-e90d5cd39683 tempest-VolumeDependencyTests-932768818 None] Created reservations ['5c0b4ce1-ee9f-48a1-be2c-15a647eb4482', '494c8d2e-19c4-4009-bb9b-99ece583a9bc', '16076d29-3a95-4ba5-b940-e6d4ecae964d', 'd0a62474-0892-411c-b97c-91591db8c89b'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:27:35 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-eeb5f217-3f7a-496d-9331-e90d5cd39683 tempest-VolumeDependencyTests-932768818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-eeb5f217-3f7a-496d-9331-e90d5cd39683 tempest-VolumeDependencyTests-932768818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:36 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-eeb5f217-3f7a-496d-9331-e90d5cd39683 tempest-VolumeDependencyTests-932768818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:27:36 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-eeb5f217-3f7a-496d-9331-e90d5cd39683 tempest-VolumeDependencyTests-932768818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:27:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-eeb5f217-3f7a-496d-9331-e90d5cd39683 tempest-VolumeDependencyTests-932768818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-eeb5f217-3f7a-496d-9331-e90d5cd39683 tempest-VolumeDependencyTests-932768818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:36 devstack sudo[114111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:27:36 devstack sudo[114111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:36 devstack sudo[114108]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-200735cf-852e-4db1-9aeb-94e047bd3764 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4.2c036968-783b-47d5-9801-e61fef94eae4" returned: 0 in 0.734s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-200735cf-852e-4db1-9aeb-94e047bd3764 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:36 devstack sudo[114114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4.info Jun 29 11:27:36 devstack sudo[114114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:36 devstack sudo[114111]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:36 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-eeb5f217-3f7a-496d-9331-e90d5cd39683 tempest-VolumeDependencyTests-932768818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.864s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:36 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-eeb5f217-3f7a-496d-9331-e90d5cd39683 tempest-VolumeDependencyTests-932768818 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:27:36 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-eeb5f217-3f7a-496d-9331-e90d5cd39683 tempest-VolumeDependencyTests-932768818 None] Deleted volume successfully. Jun 29 11:27:36 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-eeb5f217-3f7a-496d-9331-e90d5cd39683 tempest-VolumeDependencyTests-932768818 None] Lock "cinder-d3b41de2-9c7c-407d-b602-9ee7ae7d663d-delete_volume" released by "delete_volume" :: held 2.964s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:37 devstack sudo[114114]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-200735cf-852e-4db1-9aeb-94e047bd3764 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4.info" returned: 0 in 0.805s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:37 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-200735cf-852e-4db1-9aeb-94e047bd3764 tempest-CreateVolumesFromSnapshotTest-1253550899 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4.info is being set with open permissions: ugo+rw Jun 29 11:27:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-200735cf-852e-4db1-9aeb-94e047bd3764 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:37 devstack sudo[114118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4.info Jun 29 11:27:37 devstack sudo[114118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:37 devstack sudo[114118]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-200735cf-852e-4db1-9aeb-94e047bd3764 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4.info" returned: 0 in 0.719s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-200735cf-852e-4db1-9aeb-94e047bd3764 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.362s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ed182a78-0598-4d36-8937-675943378b29 tempest-CinderUnicodeTest-1032737541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.453s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:37 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-ed182a78-0598-4d36-8937-675943378b29 tempest-CinderUnicodeTest-1032737541 None] Creating offline snapshot cd268eb5-7a40-46b7-bf27-a2a18eeeb2b1 of volume 5e1a5c05-e41a-4b12-99ce-5dd31961cc6f {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:27:37 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-200735cf-852e-4db1-9aeb-94e047bd3764 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Create snapshot completed successfully Jun 29 11:27:37 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f5a0a4-06d9-4bec-9ee9-bf214c21d6f8]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:37 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ed182a78-0598-4d36-8937-675943378b29 tempest-CinderUnicodeTest-1032737541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:38 devstack sudo[114122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f Jun 29 11:27:38 devstack sudo[114122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:38 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:27:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Flow 'volume_create_manager' (bb0548cd-f527-4a19-a735-8fb30aba7393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:27:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d5f2fed-7d19-4ccb-b151-53eef028369b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d5f2fed-7d19-4ccb-b151-53eef028369b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-142866098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a54eb74e-231d-483d-b3aa-4d73b923b5be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97318f170b354c15850eeed38554dbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:27:39Z,use_quota=True,user_id='a15ad32b5b2f48aa91eb9c0eadd4b277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d1d546-7f58-4ef2-af48-e08aa35ff462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d1d546-7f58-4ef2-af48-e08aa35ff462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a981716b-6058-4356-8198-4a9baf77e0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a981716b-6058-4356-8198-4a9baf77e0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a54eb74e-231d-483d-b3aa-4d73b923b5be', 'volume_name': 'volume-a54eb74e-231d-483d-b3aa-4d73b923b5be', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d97d9cf-f858-4889-9f81-85ea1434fd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d97d9cf-f858-4889-9f81-85ea1434fd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:38 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e688653d-110f-4962-9d2e-39860172bae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:38 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Volume a54eb74e-231d-483d-b3aa-4d73b923b5be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a54eb74e-231d-483d-b3aa-4d73b923b5be', 'volume_size': 1} Jun 29 11:27:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:38 devstack sudo[114122]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ed182a78-0598-4d36-8937-675943378b29 tempest-CinderUnicodeTest-1032737541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f" returned: 0 in 1.040s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:38 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ed182a78-0598-4d36-8937-675943378b29 tempest-CinderUnicodeTest-1032737541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f.cd268eb5-7a40-46b7-bf27-a2a18eeeb2b1 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:39 devstack sudo[114127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f.cd268eb5-7a40-46b7-bf27-a2a18eeeb2b1 1G Jun 29 11:27:39 devstack sudo[114127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:39 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:27:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Flow 'volume_create_manager' (17f8a4d9-1318-4f11-ae9e-9ed4c80c5921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:27:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fd847d-e27c-46b1-87b8-bd9a28365caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fd847d-e27c-46b1-87b8-bd9a28365caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1272574977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2525087d-8d0e-4509-a7d4-88c57d04f428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97318f170b354c15850eeed38554dbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:27:39Z,use_quota=True,user_id='a15ad32b5b2f48aa91eb9c0eadd4b277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eedc4294-8dab-4e1b-9a8d-fa8a44f31eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eedc4294-8dab-4e1b-9a8d-fa8a44f31eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf68c78-8661-4192-8b95-b76acfbc7b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf68c78-8661-4192-8b95-b76acfbc7b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2525087d-8d0e-4509-a7d4-88c57d04f428', 'volume_name': 'volume-2525087d-8d0e-4509-a7d4-88c57d04f428', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de92bea-de7c-423c-bf7f-fc18843c76cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de92bea-de7c-423c-bf7f-fc18843c76cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5702b7bf-65d1-4d9c-8f07-e11d5a563753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:39 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Volume 2525087d-8d0e-4509-a7d4-88c57d04f428: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2525087d-8d0e-4509-a7d4-88c57d04f428', 'volume_size': 1} Jun 29 11:27:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:39 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:27:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Flow 'volume_create_manager' (3ae1216b-f88c-4942-ae66-956f1e4375d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:27:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1864b94a-f52e-4808-afe0-ba223b644972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1864b94a-f52e-4808-afe0-ba223b644972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1061301600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d2a93a-ba48-43fd-b54a-b1716d33b0f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97318f170b354c15850eeed38554dbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:27:40Z,use_quota=True,user_id='a15ad32b5b2f48aa91eb9c0eadd4b277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d48eca5b-9644-4253-8368-59afb642fbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d48eca5b-9644-4253-8368-59afb642fbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb1f855a-a534-4b83-9727-8a277e594a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb1f855a-a534-4b83-9727-8a277e594a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21d2a93a-ba48-43fd-b54a-b1716d33b0f7', 'volume_name': 'volume-21d2a93a-ba48-43fd-b54a-b1716d33b0f7', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22111704-a035-4b68-a00a-aba5cdeb6436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22111704-a035-4b68-a00a-aba5cdeb6436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:39 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f50a8b5-4c7d-4c61-84f2-0e2b70885932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:39 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Volume 21d2a93a-ba48-43fd-b54a-b1716d33b0f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21d2a93a-ba48-43fd-b54a-b1716d33b0f7', 'volume_size': 1} Jun 29 11:27:39 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:40 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:27:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] Flow 'volume_create_manager' (bcb9636a-92dd-4c27-b1a7-483867b7ea41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:27:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa0172b2-0170-40ff-8262-396162184afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa0172b2-0170-40ff-8262-396162184afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1664090371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25df9c9d-2f74-44ac-925f-bb524d149788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97318f170b354c15850eeed38554dbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:27:40Z,use_quota=True,user_id='a15ad32b5b2f48aa91eb9c0eadd4b277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d903ec-ba79-4101-9950-abae5ec1148c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d903ec-ba79-4101-9950-abae5ec1148c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6212bfc-14e6-4e4b-b704-3f8329173279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6212bfc-14e6-4e4b-b704-3f8329173279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25df9c9d-2f74-44ac-925f-bb524d149788', 'volume_name': 'volume-25df9c9d-2f74-44ac-925f-bb524d149788', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (537aa4dd-e294-4c5f-98c1-8a9117a799d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (537aa4dd-e294-4c5f-98c1-8a9117a799d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e285db0b-4b07-40f0-a681-af6cf248c6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:40 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] Volume 25df9c9d-2f74-44ac-925f-bb524d149788: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25df9c9d-2f74-44ac-925f-bb524d149788', 'volume_size': 1} Jun 29 11:27:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:40 devstack sudo[114127]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ed182a78-0598-4d36-8937-675943378b29 tempest-CinderUnicodeTest-1032737541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f.cd268eb5-7a40-46b7-bf27-a2a18eeeb2b1 1G" returned: 0 in 1.257s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ed182a78-0598-4d36-8937-675943378b29 tempest-CinderUnicodeTest-1032737541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f.cd268eb5-7a40-46b7-bf27-a2a18eeeb2b1 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:40 devstack sudo[114133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f.cd268eb5-7a40-46b7-bf27-a2a18eeeb2b1 Jun 29 11:27:40 devstack sudo[114133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:40 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:27:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Flow 'volume_create_manager' (390b3a41-70ff-4f5c-ae50-0e5afd5c2208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:27:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c52b2c-f084-4373-8a6a-73e29e3873eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c52b2c-f084-4373-8a6a-73e29e3873eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-213708236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b0057c4-b7c0-4a0e-82bb-20dc91776cee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97318f170b354c15850eeed38554dbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:27:41Z,use_quota=True,user_id='a15ad32b5b2f48aa91eb9c0eadd4b277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3822f2c6-c70c-4daf-bd05-05cd1b3fbea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3822f2c6-c70c-4daf-bd05-05cd1b3fbea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a0d2c5d-9309-42c8-af3b-d055be14cfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a0d2c5d-9309-42c8-af3b-d055be14cfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b0057c4-b7c0-4a0e-82bb-20dc91776cee', 'volume_name': 'volume-0b0057c4-b7c0-4a0e-82bb-20dc91776cee', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf25aed-d69d-49d2-886f-464c827b6216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf25aed-d69d-49d2-886f-464c827b6216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:40 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010ff8c8-c4c6-4d66-92fe-b61079716f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:40 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Volume 0b0057c4-b7c0-4a0e-82bb-20dc91776cee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b0057c4-b7c0-4a0e-82bb-20dc91776cee', 'volume_size': 1} Jun 29 11:27:40 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:41 devstack sudo[114133]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ed182a78-0598-4d36-8937-675943378b29 tempest-CinderUnicodeTest-1032737541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f.cd268eb5-7a40-46b7-bf27-a2a18eeeb2b1" returned: 0 in 0.758s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:41 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-ed182a78-0598-4d36-8937-675943378b29 tempest-CinderUnicodeTest-1032737541 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f.cd268eb5-7a40-46b7-bf27-a2a18eeeb2b1 is being set with open permissions: ugo+rw Jun 29 11:27:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ed182a78-0598-4d36-8937-675943378b29 tempest-CinderUnicodeTest-1032737541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f.cd268eb5-7a40-46b7-bf27-a2a18eeeb2b1 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:41 devstack sudo[114138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f.cd268eb5-7a40-46b7-bf27-a2a18eeeb2b1 Jun 29 11:27:41 devstack sudo[114138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:41 devstack sudo[114138]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ed182a78-0598-4d36-8937-675943378b29 tempest-CinderUnicodeTest-1032737541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f.cd268eb5-7a40-46b7-bf27-a2a18eeeb2b1" returned: 0 in 0.774s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:41 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ed182a78-0598-4d36-8937-675943378b29 tempest-CinderUnicodeTest-1032737541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:41 devstack sudo[114141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f.info Jun 29 11:27:41 devstack sudo[114141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:42 devstack sudo[114141]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ed182a78-0598-4d36-8937-675943378b29 tempest-CinderUnicodeTest-1032737541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f.info" returned: 0 in 0.719s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:42 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-ed182a78-0598-4d36-8937-675943378b29 tempest-CinderUnicodeTest-1032737541 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f.info is being set with open permissions: ugo+rw Jun 29 11:27:42 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ed182a78-0598-4d36-8937-675943378b29 tempest-CinderUnicodeTest-1032737541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:42 devstack sudo[114144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f.info Jun 29 11:27:42 devstack sudo[114144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:43 devstack sudo[114144]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-ed182a78-0598-4d36-8937-675943378b29 tempest-CinderUnicodeTest-1032737541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f.info" returned: 0 in 0.816s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-ed182a78-0598-4d36-8937-675943378b29 tempest-CinderUnicodeTest-1032737541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.499s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.521s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:43 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-142866098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a54eb74e-231d-483d-b3aa-4d73b923b5be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97318f170b354c15850eeed38554dbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:27:39Z,use_quota=True,user_id='a15ad32b5b2f48aa91eb9c0eadd4b277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:27:43 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Creating volume a54eb74e-231d-483d-b3aa-4d73b923b5be {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:27:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:43 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:27:43 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:27:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:43 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:27:43 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:27:43 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a54eb74e-231d-483d-b3aa-4d73b923b5be 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:43 devstack sudo[114147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a54eb74e-231d-483d-b3aa-4d73b923b5be 1073741824 Jun 29 11:27:43 devstack sudo[114147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:43 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-ed182a78-0598-4d36-8937-675943378b29 tempest-CinderUnicodeTest-1032737541 None] Create snapshot completed successfully Jun 29 11:27:44 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-54272a03-9629-4f5d-8b77-d07eb9ffc0af tempest-CinderUnicodeTest-1032737541 None] Acquiring lock "cinder-cd268eb5-7a40-46b7-bf27-a2a18eeeb2b1-delete_snapshot" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:44 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-54272a03-9629-4f5d-8b77-d07eb9ffc0af tempest-CinderUnicodeTest-1032737541 None] Lock "cinder-cd268eb5-7a40-46b7-bf27-a2a18eeeb2b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:44 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-54272a03-9629-4f5d-8b77-d07eb9ffc0af tempest-CinderUnicodeTest-1032737541 None] Acquiring lock "cinder-quobyte-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:44 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-54272a03-9629-4f5d-8b77-d07eb9ffc0af tempest-CinderUnicodeTest-1032737541 None] Lock "cinder-quobyte-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:44 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-54272a03-9629-4f5d-8b77-d07eb9ffc0af tempest-CinderUnicodeTest-1032737541 None] Acquiring lock "cinder-quobyte-cd268eb5-7a40-46b7-bf27-a2a18eeeb2b1" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:44 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-54272a03-9629-4f5d-8b77-d07eb9ffc0af tempest-CinderUnicodeTest-1032737541 None] Lock "cinder-quobyte-cd268eb5-7a40-46b7-bf27-a2a18eeeb2b1" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:44 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-54272a03-9629-4f5d-8b77-d07eb9ffc0af tempest-CinderUnicodeTest-1032737541 None] Deleting offline snapshot cd268eb5-7a40-46b7-bf27-a2a18eeeb2b1 of volume 5e1a5c05-e41a-4b12-99ce-5dd31961cc6f {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:27:44 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-54272a03-9629-4f5d-8b77-d07eb9ffc0af tempest-CinderUnicodeTest-1032737541 None] snapshot_file for this snap is: volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f.cd268eb5-7a40-46b7-bf27-a2a18eeeb2b1 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:27:44 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed4bd80-fcf2-4534-9146-5b733f34db4e]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-54272a03-9629-4f5d-8b77-d07eb9ffc0af tempest-CinderUnicodeTest-1032737541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f.cd268eb5-7a40-46b7-bf27-a2a18eeeb2b1 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:44 devstack sudo[114152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f.cd268eb5-7a40-46b7-bf27-a2a18eeeb2b1 Jun 29 11:27:44 devstack sudo[114152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:44 devstack sudo[114147]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a54eb74e-231d-483d-b3aa-4d73b923b5be 1073741824" returned: 0 in 1.154s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:44 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a54eb74e-231d-483d-b3aa-4d73b923b5be {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:44 devstack sudo[114155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a54eb74e-231d-483d-b3aa-4d73b923b5be Jun 29 11:27:44 devstack sudo[114155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:45 devstack sudo[114152]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-54272a03-9629-4f5d-8b77-d07eb9ffc0af tempest-CinderUnicodeTest-1032737541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f.cd268eb5-7a40-46b7-bf27-a2a18eeeb2b1" returned: 0 in 1.104s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:45 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-54272a03-9629-4f5d-8b77-d07eb9ffc0af tempest-CinderUnicodeTest-1032737541 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:27:45 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[789ed9d2-bc26-4a79-a743-9b4fea9488ff]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-54272a03-9629-4f5d-8b77-d07eb9ffc0af tempest-CinderUnicodeTest-1032737541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:45 devstack sudo[114161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f Jun 29 11:27:45 devstack sudo[114161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:45 devstack sudo[114155]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a54eb74e-231d-483d-b3aa-4d73b923b5be" returned: 0 in 0.887s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:45 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] <== create_volume: return (2091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:27:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.094s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.139s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:45 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1272574977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2525087d-8d0e-4509-a7d4-88c57d04f428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97318f170b354c15850eeed38554dbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:27:39Z,use_quota=True,user_id='a15ad32b5b2f48aa91eb9c0eadd4b277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:27:45 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Creating volume 2525087d-8d0e-4509-a7d4-88c57d04f428 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:27:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:45 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:27:45 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:27:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:45 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:27:45 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:27:45 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2525087d-8d0e-4509-a7d4-88c57d04f428 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e688653d-110f-4962-9d2e-39860172bae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a54eb74e-231d-483d-b3aa-4d73b923b5be', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ac0f4b-e009-4075-8ec8-de691fcfc9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:45 devstack sudo[114164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2525087d-8d0e-4509-a7d4-88c57d04f428 1073741824 Jun 29 11:27:45 devstack sudo[114164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:45 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Volume volume-a54eb74e-231d-483d-b3aa-4d73b923b5be (a54eb74e-231d-483d-b3aa-4d73b923b5be): created successfully Jun 29 11:27:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ac0f4b-e009-4075-8ec8-de691fcfc9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Flow 'volume_create_manager' (bb0548cd-f527-4a19-a735-8fb30aba7393) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:27:45 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-615fc7e2-53fd-4deb-89ca-471d7f24759b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Created volume successfully. Jun 29 11:27:45 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:27:45 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] Flow 'volume_create_manager' (cf7ff60a-5a13-483e-8836-f6591ed15498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:27:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff6b8948-a643-4bb9-a4e0-690633784adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff6b8948-a643-4bb9-a4e0-690633784adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2036440258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e6d851-1f37-4cd7-a05a-ee87129a77c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd4bc7b7946d49f1bf9a0c70def9b8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:27:46Z,use_quota=True,user_id='d006eb96f46c4cd3aa5d529929168306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7d134e1-703d-4394-a90c-035df7d961d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7d134e1-703d-4394-a90c-035df7d961d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d71122fc-db6c-4ba5-95d5-89f22adc25e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d71122fc-db6c-4ba5-95d5-89f22adc25e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3e6d851-1f37-4cd7-a05a-ee87129a77c8', 'volume_name': 'volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65df59aa-0e89-4249-a4de-27c09ecf8fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65df59aa-0e89-4249-a4de-27c09ecf8fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:46 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07bc6454-7f55-47ee-8e1b-0c150eee8c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:46 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] Volume c3e6d851-1f37-4cd7-a05a-ee87129a77c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8', 'volume_size': 1} Jun 29 11:27:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:46 devstack sudo[114161]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-54272a03-9629-4f5d-8b77-d07eb9ffc0af tempest-CinderUnicodeTest-1032737541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f" returned: 0 in 0.883s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-54272a03-9629-4f5d-8b77-d07eb9ffc0af tempest-CinderUnicodeTest-1032737541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f.cd268eb5-7a40-46b7-bf27-a2a18eeeb2b1 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:46 devstack sudo[114172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f.cd268eb5-7a40-46b7-bf27-a2a18eeeb2b1 Jun 29 11:27:46 devstack sudo[114172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:46 devstack sudo[114164]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2525087d-8d0e-4509-a7d4-88c57d04f428 1073741824" returned: 0 in 0.903s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2525087d-8d0e-4509-a7d4-88c57d04f428 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:46 devstack sudo[114174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2525087d-8d0e-4509-a7d4-88c57d04f428 Jun 29 11:27:46 devstack sudo[114174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:46 devstack sudo[114172]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-54272a03-9629-4f5d-8b77-d07eb9ffc0af tempest-CinderUnicodeTest-1032737541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f.cd268eb5-7a40-46b7-bf27-a2a18eeeb2b1" returned: 0 in 0.757s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:46 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-54272a03-9629-4f5d-8b77-d07eb9ffc0af tempest-CinderUnicodeTest-1032737541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f.cd268eb5-7a40-46b7-bf27-a2a18eeeb2b1 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:46 devstack sudo[114179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f.cd268eb5-7a40-46b7-bf27-a2a18eeeb2b1 Jun 29 11:27:46 devstack sudo[114179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:47 devstack sudo[114174]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2525087d-8d0e-4509-a7d4-88c57d04f428" returned: 0 in 0.647s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:27:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.341s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1061301600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d2a93a-ba48-43fd-b54a-b1716d33b0f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97318f170b354c15850eeed38554dbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:27:40Z,use_quota=True,user_id='a15ad32b5b2f48aa91eb9c0eadd4b277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:27:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Creating volume 21d2a93a-ba48-43fd-b54a-b1716d33b0f7 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:27:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:27:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:27:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:47 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:27:47 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:27:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-21d2a93a-ba48-43fd-b54a-b1716d33b0f7 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:47 devstack sudo[114182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-21d2a93a-ba48-43fd-b54a-b1716d33b0f7 1073741824 Jun 29 11:27:47 devstack sudo[114182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5702b7bf-65d1-4d9c-8f07-e11d5a563753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2525087d-8d0e-4509-a7d4-88c57d04f428', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20bb5da1-735a-4a78-b740-e88d4f2640a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:47 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Volume volume-2525087d-8d0e-4509-a7d4-88c57d04f428 (2525087d-8d0e-4509-a7d4-88c57d04f428): created successfully Jun 29 11:27:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20bb5da1-735a-4a78-b740-e88d4f2640a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:47 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Flow 'volume_create_manager' (17f8a4d9-1318-4f11-ae9e-9ed4c80c5921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:27:47 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-61990153-3a21-4267-989e-54dd515637b0 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Created volume successfully. Jun 29 11:27:47 devstack sudo[114179]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-54272a03-9629-4f5d-8b77-d07eb9ffc0af tempest-CinderUnicodeTest-1032737541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f.cd268eb5-7a40-46b7-bf27-a2a18eeeb2b1" returned: 0 in 0.647s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:47 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-54272a03-9629-4f5d-8b77-d07eb9ffc0af tempest-CinderUnicodeTest-1032737541 None] Lock "cinder-quobyte-cd268eb5-7a40-46b7-bf27-a2a18eeeb2b1" released by "_delete_snapshot" :: held 3.501s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:47 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-54272a03-9629-4f5d-8b77-d07eb9ffc0af tempest-CinderUnicodeTest-1032737541 None] Lock "cinder-quobyte-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f" released by "delete_snapshot" :: held 3.533s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:47 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-54272a03-9629-4f5d-8b77-d07eb9ffc0af tempest-CinderUnicodeTest-1032737541 None] Created reservations ['d9c1c8da-f902-4763-b802-f4d68c8cfd5c', 'ae634692-1d65-4745-8269-e99fd11bd6e6', '606befb1-c46a-40ed-82c9-52bc916674c9', 'b5b4765e-a089-4272-afa3-68beb79604ed'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:27:47 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-54272a03-9629-4f5d-8b77-d07eb9ffc0af tempest-CinderUnicodeTest-1032737541 None] Delete snapshot completed successfully. Jun 29 11:27:47 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-54272a03-9629-4f5d-8b77-d07eb9ffc0af tempest-CinderUnicodeTest-1032737541 None] Lock "cinder-cd268eb5-7a40-46b7-bf27-a2a18eeeb2b1-delete_snapshot" released by "delete_snapshot" :: held 3.690s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:47 devstack sudo[114182]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-21d2a93a-ba48-43fd-b54a-b1716d33b0f7 1073741824" returned: 0 in 0.858s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:47 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-21d2a93a-ba48-43fd-b54a-b1716d33b0f7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:48 devstack sudo[114192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-21d2a93a-ba48-43fd-b54a-b1716d33b0f7 Jun 29 11:27:48 devstack sudo[114192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:48 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-bbbc64e2-4ef4-459b-9588-bb1f5775fba0 tempest-CinderUnicodeTest-1032737541 None] Acquiring lock "cinder-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:48 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-bbbc64e2-4ef4-459b-9588-bb1f5775fba0 tempest-CinderUnicodeTest-1032737541 None] Lock "cinder-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:48 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-bbbc64e2-4ef4-459b-9588-bb1f5775fba0 tempest-CinderUnicodeTest-1032737541 None] Acquiring lock "cinder-quobyte-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:48 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-bbbc64e2-4ef4-459b-9588-bb1f5775fba0 tempest-CinderUnicodeTest-1032737541 None] Lock "cinder-quobyte-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f" acquired by "delete_volume" :: waited 0.015s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:48 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8378d9a-fbb1-4f8e-a7fa-a88fec3dcaa6]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-bbbc64e2-4ef4-459b-9588-bb1f5775fba0 tempest-CinderUnicodeTest-1032737541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:48 devstack sudo[114194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f Jun 29 11:27:48 devstack sudo[114194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:48 devstack sudo[114192]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-21d2a93a-ba48-43fd-b54a-b1716d33b0f7" returned: 0 in 0.625s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:48 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:27:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.378s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:48 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1664090371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25df9c9d-2f74-44ac-925f-bb524d149788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97318f170b354c15850eeed38554dbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:27:40Z,use_quota=True,user_id='a15ad32b5b2f48aa91eb9c0eadd4b277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:27:48 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] Creating volume 25df9c9d-2f74-44ac-925f-bb524d149788 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:27:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:48 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:27:48 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:27:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:48 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:27:48 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:27:48 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-25df9c9d-2f74-44ac-925f-bb524d149788 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:48 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f50a8b5-4c7d-4c61-84f2-0e2b70885932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21d2a93a-ba48-43fd-b54a-b1716d33b0f7', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:48 devstack sudo[114197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-25df9c9d-2f74-44ac-925f-bb524d149788 1073741824 Jun 29 11:27:48 devstack sudo[114197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:48 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f945df25-4222-4880-a760-671e7eb003aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:48 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Volume volume-21d2a93a-ba48-43fd-b54a-b1716d33b0f7 (21d2a93a-ba48-43fd-b54a-b1716d33b0f7): created successfully Jun 29 11:27:48 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f945df25-4222-4880-a760-671e7eb003aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:48 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Flow 'volume_create_manager' (3ae1216b-f88c-4942-ae66-956f1e4375d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:27:48 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-0bd2b52d-0352-454e-bf4b-27a718246a3b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Created volume successfully. Jun 29 11:27:49 devstack sudo[114194]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-bbbc64e2-4ef4-459b-9588-bb1f5775fba0 tempest-CinderUnicodeTest-1032737541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f" returned: 0 in 0.742s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-bbbc64e2-4ef4-459b-9588-bb1f5775fba0 tempest-CinderUnicodeTest-1032737541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:49 devstack sudo[114205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f Jun 29 11:27:49 devstack sudo[114205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:49 devstack sudo[114197]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-25df9c9d-2f74-44ac-925f-bb524d149788 1073741824" returned: 0 in 0.881s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-25df9c9d-2f74-44ac-925f-bb524d149788 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:49 devstack sudo[114208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-25df9c9d-2f74-44ac-925f-bb524d149788 Jun 29 11:27:49 devstack sudo[114208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:49 devstack sudo[114205]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-bbbc64e2-4ef4-459b-9588-bb1f5775fba0 tempest-CinderUnicodeTest-1032737541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f" returned: 0 in 0.653s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:49 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-bbbc64e2-4ef4-459b-9588-bb1f5775fba0 tempest-CinderUnicodeTest-1032737541 None] Lock "cinder-quobyte-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f" released by "delete_volume" :: held 1.457s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:49 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-bbbc64e2-4ef4-459b-9588-bb1f5775fba0 tempest-CinderUnicodeTest-1032737541 None] Created reservations ['e0ee6792-ef8d-486c-af99-ce96f7accef7', 'ea8d23fe-2a15-4b80-917b-ca018977172d', '25f7eaa3-34bb-46d1-a008-d48548291421', '212d90dc-127e-4c1b-91a4-92b09fdea188'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:27:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-bbbc64e2-4ef4-459b-9588-bb1f5775fba0 tempest-CinderUnicodeTest-1032737541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-bbbc64e2-4ef4-459b-9588-bb1f5775fba0 tempest-CinderUnicodeTest-1032737541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:49 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-bbbc64e2-4ef4-459b-9588-bb1f5775fba0 tempest-CinderUnicodeTest-1032737541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:27:49 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-bbbc64e2-4ef4-459b-9588-bb1f5775fba0 tempest-CinderUnicodeTest-1032737541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:27:49 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-bbbc64e2-4ef4-459b-9588-bb1f5775fba0 tempest-CinderUnicodeTest-1032737541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-bbbc64e2-4ef4-459b-9588-bb1f5775fba0 tempest-CinderUnicodeTest-1032737541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:50 devstack sudo[114211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:27:50 devstack sudo[114211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:50 devstack sudo[114208]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-25df9c9d-2f74-44ac-925f-bb524d149788" returned: 0 in 0.690s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:27:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.532s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-213708236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b0057c4-b7c0-4a0e-82bb-20dc91776cee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97318f170b354c15850eeed38554dbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:27:41Z,use_quota=True,user_id='a15ad32b5b2f48aa91eb9c0eadd4b277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:27:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Creating volume 0b0057c4-b7c0-4a0e-82bb-20dc91776cee {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:27:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:27:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:27:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:50 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:27:50 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:27:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0b0057c4-b7c0-4a0e-82bb-20dc91776cee 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e285db0b-4b07-40f0-a681-af6cf248c6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25df9c9d-2f74-44ac-925f-bb524d149788', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:50 devstack sudo[114214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0b0057c4-b7c0-4a0e-82bb-20dc91776cee 1073741824 Jun 29 11:27:50 devstack sudo[114214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42d8b104-b3ef-4593-b726-79e49691a946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:50 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] Volume volume-25df9c9d-2f74-44ac-925f-bb524d149788 (25df9c9d-2f74-44ac-925f-bb524d149788): created successfully Jun 29 11:27:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42d8b104-b3ef-4593-b726-79e49691a946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:50 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] Flow 'volume_create_manager' (bcb9636a-92dd-4c27-b1a7-483867b7ea41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:27:50 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-2fe0a452-5181-498b-866e-4f393a413fec tempest-CreateVolumesFromSnapshotTest-1253550899 None] Created volume successfully. Jun 29 11:27:50 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-bd878671-37fc-454f-ab81-cf0f03361a07 tempest-CinderUnicodeTest-1032737541 None] Acquiring lock "cinder-575590bb-3668-4288-bda9-b24818eea871-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:50 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-bd878671-37fc-454f-ab81-cf0f03361a07 tempest-CinderUnicodeTest-1032737541 None] Lock "cinder-575590bb-3668-4288-bda9-b24818eea871-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:50 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-bd878671-37fc-454f-ab81-cf0f03361a07 tempest-CinderUnicodeTest-1032737541 None] Acquiring lock "cinder-quobyte-575590bb-3668-4288-bda9-b24818eea871" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:50 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-bd878671-37fc-454f-ab81-cf0f03361a07 tempest-CinderUnicodeTest-1032737541 None] Lock "cinder-quobyte-575590bb-3668-4288-bda9-b24818eea871" acquired by "delete_volume" :: waited 0.019s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:50 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[a811720f-f325-424a-888a-dfdb0b5ac117]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-bd878671-37fc-454f-ab81-cf0f03361a07 tempest-CinderUnicodeTest-1032737541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-575590bb-3668-4288-bda9-b24818eea871 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:50 devstack sudo[114211]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:50 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-bbbc64e2-4ef4-459b-9588-bb1f5775fba0 tempest-CinderUnicodeTest-1032737541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.800s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:50 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-bbbc64e2-4ef4-459b-9588-bb1f5775fba0 tempest-CinderUnicodeTest-1032737541 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:27:50 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-bbbc64e2-4ef4-459b-9588-bb1f5775fba0 tempest-CinderUnicodeTest-1032737541 None] Deleted volume successfully. Jun 29 11:27:50 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-bbbc64e2-4ef4-459b-9588-bb1f5775fba0 tempest-CinderUnicodeTest-1032737541 None] Lock "cinder-5e1a5c05-e41a-4b12-99ce-5dd31961cc6f-delete_volume" released by "delete_volume" :: held 2.471s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:50 devstack sudo[114217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-575590bb-3668-4288-bda9-b24818eea871 Jun 29 11:27:50 devstack sudo[114217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:51 devstack sudo[114214]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0b0057c4-b7c0-4a0e-82bb-20dc91776cee 1073741824" returned: 0 in 0.938s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0b0057c4-b7c0-4a0e-82bb-20dc91776cee {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:51 devstack sudo[114222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0b0057c4-b7c0-4a0e-82bb-20dc91776cee Jun 29 11:27:51 devstack sudo[114222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:51 devstack sudo[114217]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-bd878671-37fc-454f-ab81-cf0f03361a07 tempest-CinderUnicodeTest-1032737541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-575590bb-3668-4288-bda9-b24818eea871" returned: 0 in 0.800s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-bd878671-37fc-454f-ab81-cf0f03361a07 tempest-CinderUnicodeTest-1032737541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-575590bb-3668-4288-bda9-b24818eea871 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:51 devstack sudo[114227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-575590bb-3668-4288-bda9-b24818eea871 Jun 29 11:27:51 devstack sudo[114227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:51 devstack sudo[114222]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0b0057c4-b7c0-4a0e-82bb-20dc91776cee" returned: 0 in 0.663s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:27:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.825s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2036440258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e6d851-1f37-4cd7-a05a-ee87129a77c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd4bc7b7946d49f1bf9a0c70def9b8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:27:46Z,use_quota=True,user_id='d006eb96f46c4cd3aa5d529929168306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)}" {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 11:27:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] Creating volume c3e6d851-1f37-4cd7-a05a-ee87129a77c8 {{(pid=93497) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 11:27:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:27:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:27:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:51 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:27:51 devstack cinder-volume[93497]: INFO cinder.volume.drivers.remotefs [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] casted to osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 Jun 29 11:27:51 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8 1073741824 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:51 devstack sudo[114230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8 1073741824 Jun 29 11:27:51 devstack sudo[114230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010ff8c8-c4c6-4d66-92fe-b61079716f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b0057c4-b7c0-4a0e-82bb-20dc91776cee', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2314ac3b-63fd-4c50-b429-7b4d91f4b7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:51 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Volume volume-0b0057c4-b7c0-4a0e-82bb-20dc91776cee (0b0057c4-b7c0-4a0e-82bb-20dc91776cee): created successfully Jun 29 11:27:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2314ac3b-63fd-4c50-b429-7b4d91f4b7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:51 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Flow 'volume_create_manager' (390b3a41-70ff-4f5c-ae50-0e5afd5c2208) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:27:51 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-004dd989-f464-471c-8779-bb2b45954945 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Created volume successfully. Jun 29 11:27:52 devstack sudo[114227]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-bd878671-37fc-454f-ab81-cf0f03361a07 tempest-CinderUnicodeTest-1032737541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-575590bb-3668-4288-bda9-b24818eea871" returned: 0 in 0.655s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:52 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-bd878671-37fc-454f-ab81-cf0f03361a07 tempest-CinderUnicodeTest-1032737541 None] Lock "cinder-quobyte-575590bb-3668-4288-bda9-b24818eea871" released by "delete_volume" :: held 1.501s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:52 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-bd878671-37fc-454f-ab81-cf0f03361a07 tempest-CinderUnicodeTest-1032737541 None] Created reservations ['d4ab6810-43b2-4081-aca8-abf5bc62102b', 'fbc0e233-2ded-4a27-a9bf-2df73b0aa94e', '4e786bec-355c-4ffd-bf0b-7f3ba519b00a', '09517e38-6621-4a98-82c6-a472220a33dd'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:27:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-bd878671-37fc-454f-ab81-cf0f03361a07 tempest-CinderUnicodeTest-1032737541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-bd878671-37fc-454f-ab81-cf0f03361a07 tempest-CinderUnicodeTest-1032737541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:52 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-bd878671-37fc-454f-ab81-cf0f03361a07 tempest-CinderUnicodeTest-1032737541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:27:52 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-bd878671-37fc-454f-ab81-cf0f03361a07 tempest-CinderUnicodeTest-1032737541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:27:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-bd878671-37fc-454f-ab81-cf0f03361a07 tempest-CinderUnicodeTest-1032737541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-bd878671-37fc-454f-ab81-cf0f03361a07 tempest-CinderUnicodeTest-1032737541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:52 devstack sudo[114233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:27:52 devstack sudo[114233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:52 devstack sudo[114230]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8 1073741824" returned: 0 in 0.831s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:52 devstack sudo[114239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8 Jun 29 11:27:52 devstack sudo[114239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:52 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-116a6ca7-4821-40af-9341-74f76a0d4dd8 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "cinder-0b0057c4-b7c0-4a0e-82bb-20dc91776cee-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:52 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-116a6ca7-4821-40af-9341-74f76a0d4dd8 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "cinder-0b0057c4-b7c0-4a0e-82bb-20dc91776cee-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:52 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-116a6ca7-4821-40af-9341-74f76a0d4dd8 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "cinder-quobyte-0b0057c4-b7c0-4a0e-82bb-20dc91776cee" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:52 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-116a6ca7-4821-40af-9341-74f76a0d4dd8 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "cinder-quobyte-0b0057c4-b7c0-4a0e-82bb-20dc91776cee" acquired by "delete_volume" :: waited 0.023s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:52 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aaaa1dc-5edc-4ddd-b3fe-f943118a852f]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:52 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-116a6ca7-4821-40af-9341-74f76a0d4dd8 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0b0057c4-b7c0-4a0e-82bb-20dc91776cee {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:53 devstack sudo[114241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0b0057c4-b7c0-4a0e-82bb-20dc91776cee Jun 29 11:27:53 devstack sudo[114241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:53 devstack sudo[114233]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-bd878671-37fc-454f-ab81-cf0f03361a07 tempest-CinderUnicodeTest-1032737541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.736s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:53 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-bd878671-37fc-454f-ab81-cf0f03361a07 tempest-CinderUnicodeTest-1032737541 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:27:53 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-bd878671-37fc-454f-ab81-cf0f03361a07 tempest-CinderUnicodeTest-1032737541 None] Deleted volume successfully. Jun 29 11:27:53 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-bd878671-37fc-454f-ab81-cf0f03361a07 tempest-CinderUnicodeTest-1032737541 None] Lock "cinder-575590bb-3668-4288-bda9-b24818eea871-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:53 devstack sudo[114239]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8" returned: 0 in 0.710s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:53 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'} {{(pid=93497) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 11:27:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07bc6454-7f55-47ee-8e1b-0c150eee8c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8', 'volume_size': 1}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b71b9362-efc3-451e-8191-42b053253970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:27:53 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] Volume volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8 (c3e6d851-1f37-4cd7-a05a-ee87129a77c8): created successfully Jun 29 11:27:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b71b9362-efc3-451e-8191-42b053253970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:27:53 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] Flow 'volume_create_manager' (cf7ff60a-5a13-483e-8836-f6591ed15498) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:27:53 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-7f3897cf-b8c5-41f7-af7a-243706b6ca53 tempest-SnapshotDependencyTests-899269649 None] Created volume successfully. Jun 29 11:27:53 devstack sudo[114241]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-116a6ca7-4821-40af-9341-74f76a0d4dd8 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0b0057c4-b7c0-4a0e-82bb-20dc91776cee" returned: 0 in 0.875s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:53 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-116a6ca7-4821-40af-9341-74f76a0d4dd8 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0b0057c4-b7c0-4a0e-82bb-20dc91776cee {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:53 devstack sudo[114248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0b0057c4-b7c0-4a0e-82bb-20dc91776cee Jun 29 11:27:53 devstack sudo[114248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:54 devstack sudo[114248]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-116a6ca7-4821-40af-9341-74f76a0d4dd8 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-0b0057c4-b7c0-4a0e-82bb-20dc91776cee" returned: 0 in 0.702s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:54 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-116a6ca7-4821-40af-9341-74f76a0d4dd8 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "cinder-quobyte-0b0057c4-b7c0-4a0e-82bb-20dc91776cee" released by "delete_volume" :: held 1.638s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:54 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-116a6ca7-4821-40af-9341-74f76a0d4dd8 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Created reservations ['955b9b39-aeac-4f1e-8c99-1c5c25b02426', '7506700d-5a1b-4ea0-aadc-0ef88d995ebf', '04901dfc-80ce-4856-94a3-62f2653b55ff', '3a63d35b-7476-424b-9caa-fdf998f55501'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:27:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4307a341-993d-4b06-a625-c8630a2a15ef tempest-SnapshotDependencyTests-899269649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4307a341-993d-4b06-a625-c8630a2a15ef tempest-SnapshotDependencyTests-899269649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-4307a341-993d-4b06-a625-c8630a2a15ef tempest-SnapshotDependencyTests-899269649 None] Creating offline snapshot ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7 of volume c3e6d851-1f37-4cd7-a05a-ee87129a77c8 {{(pid=93497) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 11:27:54 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0384f7-f9e5-498c-80db-66f9ec893a52]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4307a341-993d-4b06-a625-c8630a2a15ef tempest-SnapshotDependencyTests-899269649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-116a6ca7-4821-40af-9341-74f76a0d4dd8 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-116a6ca7-4821-40af-9341-74f76a0d4dd8 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-116a6ca7-4821-40af-9341-74f76a0d4dd8 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:27:54 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-116a6ca7-4821-40af-9341-74f76a0d4dd8 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:27:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-116a6ca7-4821-40af-9341-74f76a0d4dd8 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:54 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-116a6ca7-4821-40af-9341-74f76a0d4dd8 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:54 devstack sudo[114252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:27:54 devstack sudo[114252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:54 devstack sudo[114251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8 Jun 29 11:27:54 devstack sudo[114251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1c464ba9-1d6e-4ffd-8ddc-fd9eef63ec39 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "cinder-25df9c9d-2f74-44ac-925f-bb524d149788-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1c464ba9-1d6e-4ffd-8ddc-fd9eef63ec39 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "cinder-25df9c9d-2f74-44ac-925f-bb524d149788-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1c464ba9-1d6e-4ffd-8ddc-fd9eef63ec39 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "cinder-quobyte-25df9c9d-2f74-44ac-925f-bb524d149788" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1c464ba9-1d6e-4ffd-8ddc-fd9eef63ec39 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "cinder-quobyte-25df9c9d-2f74-44ac-925f-bb524d149788" acquired by "delete_volume" :: waited 0.021s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:55 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[437e7380-0778-4f0a-b836-07376749ba23]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1c464ba9-1d6e-4ffd-8ddc-fd9eef63ec39 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-25df9c9d-2f74-44ac-925f-bb524d149788 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:55 devstack sudo[114255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-25df9c9d-2f74-44ac-925f-bb524d149788 Jun 29 11:27:55 devstack sudo[114255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:55 devstack sudo[114252]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-116a6ca7-4821-40af-9341-74f76a0d4dd8 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.653s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:55 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-116a6ca7-4821-40af-9341-74f76a0d4dd8 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:27:55 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-116a6ca7-4821-40af-9341-74f76a0d4dd8 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Deleted volume successfully. Jun 29 11:27:55 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-116a6ca7-4821-40af-9341-74f76a0d4dd8 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "cinder-0b0057c4-b7c0-4a0e-82bb-20dc91776cee-delete_volume" released by "delete_volume" :: held 2.596s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:55 devstack sudo[114251]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4307a341-993d-4b06-a625-c8630a2a15ef tempest-SnapshotDependencyTests-899269649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8" returned: 0 in 0.813s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4307a341-993d-4b06-a625-c8630a2a15ef tempest-SnapshotDependencyTests-899269649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8.ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7 1G {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:55 devstack sudo[114261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8.ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7 1G Jun 29 11:27:55 devstack sudo[114261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:55 devstack sudo[114255]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1c464ba9-1d6e-4ffd-8ddc-fd9eef63ec39 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-25df9c9d-2f74-44ac-925f-bb524d149788" returned: 0 in 0.744s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:55 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1c464ba9-1d6e-4ffd-8ddc-fd9eef63ec39 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-25df9c9d-2f74-44ac-925f-bb524d149788 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:55 devstack sudo[114266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-25df9c9d-2f74-44ac-925f-bb524d149788 Jun 29 11:27:55 devstack sudo[114266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:56 devstack sudo[114261]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4307a341-993d-4b06-a625-c8630a2a15ef tempest-SnapshotDependencyTests-899269649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8.ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7 1G" returned: 0 in 0.833s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4307a341-993d-4b06-a625-c8630a2a15ef tempest-SnapshotDependencyTests-899269649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8.ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:56 devstack sudo[114271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8.ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7 Jun 29 11:27:56 devstack sudo[114271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:56 devstack sudo[114266]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1c464ba9-1d6e-4ffd-8ddc-fd9eef63ec39 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-25df9c9d-2f74-44ac-925f-bb524d149788" returned: 0 in 0.679s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:56 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1c464ba9-1d6e-4ffd-8ddc-fd9eef63ec39 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "cinder-quobyte-25df9c9d-2f74-44ac-925f-bb524d149788" released by "delete_volume" :: held 1.477s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:56 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-1c464ba9-1d6e-4ffd-8ddc-fd9eef63ec39 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Created reservations ['edc885ac-ff34-4fc2-9a40-5a8278c8768d', 'f5d91424-5264-4d95-8d76-518c32a9d01e', '39c01bd4-f961-4f2c-9e22-86332409e03b', '2c67dbd4-5380-4025-b425-e912a1f24346'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:27:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1c464ba9-1d6e-4ffd-8ddc-fd9eef63ec39 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1c464ba9-1d6e-4ffd-8ddc-fd9eef63ec39 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1c464ba9-1d6e-4ffd-8ddc-fd9eef63ec39 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:27:56 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-1c464ba9-1d6e-4ffd-8ddc-fd9eef63ec39 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:27:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-1c464ba9-1d6e-4ffd-8ddc-fd9eef63ec39 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:56 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1c464ba9-1d6e-4ffd-8ddc-fd9eef63ec39 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:56 devstack sudo[114274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:27:56 devstack sudo[114274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:57 devstack sudo[114271]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4307a341-993d-4b06-a625-c8630a2a15ef tempest-SnapshotDependencyTests-899269649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8 -F qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8.ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7" returned: 0 in 0.670s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:57 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-4307a341-993d-4b06-a625-c8630a2a15ef tempest-SnapshotDependencyTests-899269649 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8.ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7 is being set with open permissions: ugo+rw Jun 29 11:27:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4307a341-993d-4b06-a625-c8630a2a15ef tempest-SnapshotDependencyTests-899269649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8.ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:57 devstack sudo[114279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8.ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7 Jun 29 11:27:57 devstack sudo[114279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:57 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a3469052-08c3-47e4-ad9d-01ad9ed54e69 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "cinder-21d2a93a-ba48-43fd-b54a-b1716d33b0f7-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:57 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a3469052-08c3-47e4-ad9d-01ad9ed54e69 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "cinder-21d2a93a-ba48-43fd-b54a-b1716d33b0f7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:57 devstack sudo[114274]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-1c464ba9-1d6e-4ffd-8ddc-fd9eef63ec39 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.648s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:57 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-1c464ba9-1d6e-4ffd-8ddc-fd9eef63ec39 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:27:57 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-1c464ba9-1d6e-4ffd-8ddc-fd9eef63ec39 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Deleted volume successfully. Jun 29 11:27:57 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a3469052-08c3-47e4-ad9d-01ad9ed54e69 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "cinder-quobyte-21d2a93a-ba48-43fd-b54a-b1716d33b0f7" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:57 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a3469052-08c3-47e4-ad9d-01ad9ed54e69 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "cinder-quobyte-21d2a93a-ba48-43fd-b54a-b1716d33b0f7" acquired by "delete_volume" :: waited 0.017s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:57 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-1c464ba9-1d6e-4ffd-8ddc-fd9eef63ec39 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "cinder-25df9c9d-2f74-44ac-925f-bb524d149788-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:57 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[58af7700-70ed-4a55-a7b4-06ab20285b8e]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a3469052-08c3-47e4-ad9d-01ad9ed54e69 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-21d2a93a-ba48-43fd-b54a-b1716d33b0f7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:57 devstack sudo[114282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-21d2a93a-ba48-43fd-b54a-b1716d33b0f7 Jun 29 11:27:57 devstack sudo[114282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:57 devstack sudo[114279]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4307a341-993d-4b06-a625-c8630a2a15ef tempest-SnapshotDependencyTests-899269649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8.ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7" returned: 0 in 0.629s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:57 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4307a341-993d-4b06-a625-c8630a2a15ef tempest-SnapshotDependencyTests-899269649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:57 devstack sudo[114285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8.info Jun 29 11:27:57 devstack sudo[114285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:58 devstack sudo[114282]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a3469052-08c3-47e4-ad9d-01ad9ed54e69 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-21d2a93a-ba48-43fd-b54a-b1716d33b0f7" returned: 0 in 0.742s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a3469052-08c3-47e4-ad9d-01ad9ed54e69 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-21d2a93a-ba48-43fd-b54a-b1716d33b0f7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:58 devstack sudo[114305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-21d2a93a-ba48-43fd-b54a-b1716d33b0f7 Jun 29 11:27:58 devstack sudo[114305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:58 devstack sudo[114285]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4307a341-993d-4b06-a625-c8630a2a15ef tempest-SnapshotDependencyTests-899269649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8.info" returned: 0 in 0.666s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:58 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-4307a341-993d-4b06-a625-c8630a2a15ef tempest-SnapshotDependencyTests-899269649 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8.info is being set with open permissions: ugo+rw Jun 29 11:27:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4307a341-993d-4b06-a625-c8630a2a15ef tempest-SnapshotDependencyTests-899269649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8.info {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:58 devstack sudo[114328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8.info Jun 29 11:27:58 devstack sudo[114328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:58 devstack sudo[114305]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:58 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a3469052-08c3-47e4-ad9d-01ad9ed54e69 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-21d2a93a-ba48-43fd-b54a-b1716d33b0f7" returned: 0 in 0.729s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:58 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a3469052-08c3-47e4-ad9d-01ad9ed54e69 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "cinder-quobyte-21d2a93a-ba48-43fd-b54a-b1716d33b0f7" released by "delete_volume" :: held 1.527s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:58 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-a3469052-08c3-47e4-ad9d-01ad9ed54e69 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Created reservations ['89eb7ba0-f93e-4e74-aee8-9387a8a2b374', 'c0a686d7-0c10-452f-8dd1-2f620e4f8ee1', '5808c231-321b-4912-ad28-99a8534e35e6', 'a10917e3-e252-40a6-a7b1-2e776117b683'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:27:58 devstack sudo[114328]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4307a341-993d-4b06-a625-c8630a2a15ef tempest-SnapshotDependencyTests-899269649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8.info" returned: 0 in 0.638s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4307a341-993d-4b06-a625-c8630a2a15ef tempest-SnapshotDependencyTests-899269649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.341s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:59 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-4307a341-993d-4b06-a625-c8630a2a15ef tempest-SnapshotDependencyTests-899269649 None] Create snapshot completed successfully Jun 29 11:27:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a3469052-08c3-47e4-ad9d-01ad9ed54e69 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:27:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a3469052-08c3-47e4-ad9d-01ad9ed54e69 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:27:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a3469052-08c3-47e4-ad9d-01ad9ed54e69 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:27:59 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-a3469052-08c3-47e4-ad9d-01ad9ed54e69 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:27:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-a3469052-08c3-47e4-ad9d-01ad9ed54e69 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:27:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a3469052-08c3-47e4-ad9d-01ad9ed54e69 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:59 devstack sudo[114334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:27:59 devstack sudo[114334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:27:59 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e5c51995-b7eb-449a-94d7-48841e2b0840 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "cinder-2525087d-8d0e-4509-a7d4-88c57d04f428-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:59 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e5c51995-b7eb-449a-94d7-48841e2b0840 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "cinder-2525087d-8d0e-4509-a7d4-88c57d04f428-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:59 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e5c51995-b7eb-449a-94d7-48841e2b0840 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "cinder-quobyte-2525087d-8d0e-4509-a7d4-88c57d04f428" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:27:59 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e5c51995-b7eb-449a-94d7-48841e2b0840 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "cinder-quobyte-2525087d-8d0e-4509-a7d4-88c57d04f428" acquired by "delete_volume" :: waited 0.015s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:27:59 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebac9dd-1fb3-47dd-9912-d3c8793d4b5a]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:27:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e5c51995-b7eb-449a-94d7-48841e2b0840 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2525087d-8d0e-4509-a7d4-88c57d04f428 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:27:59 devstack sudo[114334]: pam_unix(sudo:session): session closed for user root Jun 29 11:27:59 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a3469052-08c3-47e4-ad9d-01ad9ed54e69 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.664s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:27:59 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-a3469052-08c3-47e4-ad9d-01ad9ed54e69 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:27:59 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-a3469052-08c3-47e4-ad9d-01ad9ed54e69 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Deleted volume successfully. Jun 29 11:27:59 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a3469052-08c3-47e4-ad9d-01ad9ed54e69 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "cinder-21d2a93a-ba48-43fd-b54a-b1716d33b0f7-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:27:59 devstack sudo[114337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2525087d-8d0e-4509-a7d4-88c57d04f428 Jun 29 11:27:59 devstack sudo[114337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:28:00 devstack sudo[114337]: pam_unix(sudo:session): session closed for user root Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG cinder.volume.flows.manager.create_volume [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93497) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e5c51995-b7eb-449a-94d7-48841e2b0840 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2525087d-8d0e-4509-a7d4-88c57d04f428" returned: 0 in 0.810s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e5c51995-b7eb-449a-94d7-48841e2b0840 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2525087d-8d0e-4509-a7d4-88c57d04f428 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:28:00 devstack sudo[114342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2525087d-8d0e-4509-a7d4-88c57d04f428 Jun 29 11:28:00 devstack sudo[114342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Flow 'volume_create_manager' (08ca7e37-1650-439a-9ba4-6c257146c3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51046145-2f57-47ee-9e47-83333beb7f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51046145-2f57-47ee-9e47-83333beb7f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T09:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=880ed4a6-a4c0-4d22-a98f-ee8f02487bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd4bc7b7946d49f1bf9a0c70def9b8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T09:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T09:28:00Z,use_quota=True,user_id='d006eb96f46c4cd3aa5d529929168306',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f475252-fd19-40f5-bd84-ebe3ef30402a),volume_type_id=4f475252-fd19-40f5-bd84-ebe3ef30402a)' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74a66bd9-1752-48fd-aa39-c72f27fed46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74a66bd9-1752-48fd-aa39-c72f27fed46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f77b3247-a703-4ec2-bf9d-d479084a8a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f77b3247-a703-4ec2-bf9d-d479084a8a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '880ed4a6-a4c0-4d22-a98f-ee8f02487bd8', 'volume_name': 'volume-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8', 'volume_size': 1, 'snapshot_id': 'ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7'}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e29cc1fe-4b13-43f4-9e78-91170b8d2d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e29cc1fe-4b13-43f4-9e78-91170b8d2d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe5baec-ecde-4eb4-99d5-3da2bcd480f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:28:00 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Volume 880ed4a6-a4c0-4d22-a98f-ee8f02487bd8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8', 'volume_size': 1, 'snapshot_id': 'ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7'} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Acquiring lock "cinder-quobyte-ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8" by "_create_volume_from_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Lock "cinder-quobyte-ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Creating volume 880ed4a6-a4c0-4d22-a98f-ee8f02487bd8 from snapshot ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7 {{(pid=93497) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Selected osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3 as target Quobyte volume. {{(pid=93497) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Acquiring lock "cinder-quobyte-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8" by "_copy_volume_from_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Lock "cinder-quobyte-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] snapshot: ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7, volume: 880ed4a6-a4c0-4d22-a98f-ee8f02487bd8, {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0800580-7641-435c-9ad0-ff3a55f69579]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:28:00 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8.ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:28:00 devstack sudo[114344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8.ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7 Jun 29 11:28:00 devstack sudo[114344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:28:01 devstack sudo[114342]: pam_unix(sudo:session): session closed for user root Jun 29 11:28:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e5c51995-b7eb-449a-94d7-48841e2b0840 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-2525087d-8d0e-4509-a7d4-88c57d04f428" returned: 0 in 0.649s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:28:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e5c51995-b7eb-449a-94d7-48841e2b0840 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "cinder-quobyte-2525087d-8d0e-4509-a7d4-88c57d04f428" released by "delete_volume" :: held 1.503s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:28:01 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-e5c51995-b7eb-449a-94d7-48841e2b0840 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Created reservations ['97dc85dd-9a7b-4cfc-ac6e-264b414d815e', '0c6ee7f0-fe51-4a74-8e24-d3417a117de1', '24c21953-6fad-4133-86a5-cea6bbc6a068', 'cc5b6b26-21a2-445b-9824-30cb2545ffeb'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:28:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e5c51995-b7eb-449a-94d7-48841e2b0840 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:28:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e5c51995-b7eb-449a-94d7-48841e2b0840 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:28:01 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-e5c51995-b7eb-449a-94d7-48841e2b0840 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:28:01 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-e5c51995-b7eb-449a-94d7-48841e2b0840 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:28:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-e5c51995-b7eb-449a-94d7-48841e2b0840 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:28:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e5c51995-b7eb-449a-94d7-48841e2b0840 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:28:01 devstack sudo[114347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:28:01 devstack sudo[114347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:28:01 devstack sudo[114344]: pam_unix(sudo:session): session closed for user root Jun 29 11:28:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8.ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7" returned: 0 in 0.750s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:28:01 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:28:01 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8 {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 11:28:01 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Creating direct copy from snapshot {{(pid=93497) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 11:28:01 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2caba5c-25b1-4884-aba1-fa0e9cc8e000]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:28:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:28:01 devstack sudo[114352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8 Jun 29 11:28:01 devstack sudo[114352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:28:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-61022375-845b-4877-80a9-692d5c7c3780 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "cinder-a54eb74e-231d-483d-b3aa-4d73b923b5be-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:28:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-61022375-845b-4877-80a9-692d5c7c3780 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "cinder-a54eb74e-231d-483d-b3aa-4d73b923b5be-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:28:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-61022375-845b-4877-80a9-692d5c7c3780 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "cinder-quobyte-a54eb74e-231d-483d-b3aa-4d73b923b5be" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:28:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-61022375-845b-4877-80a9-692d5c7c3780 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "cinder-quobyte-a54eb74e-231d-483d-b3aa-4d73b923b5be" acquired by "delete_volume" :: waited 0.017s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:28:01 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2c8c5e-0767-4ac9-9af0-79a07731ba65]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:28:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-61022375-845b-4877-80a9-692d5c7c3780 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a54eb74e-231d-483d-b3aa-4d73b923b5be {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:28:01 devstack sudo[114347]: pam_unix(sudo:session): session closed for user root Jun 29 11:28:01 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-e5c51995-b7eb-449a-94d7-48841e2b0840 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.685s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:28:01 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-e5c51995-b7eb-449a-94d7-48841e2b0840 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:28:01 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-e5c51995-b7eb-449a-94d7-48841e2b0840 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Deleted volume successfully. Jun 29 11:28:01 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-e5c51995-b7eb-449a-94d7-48841e2b0840 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "cinder-2525087d-8d0e-4509-a7d4-88c57d04f428-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:28:02 devstack sudo[114355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a54eb74e-231d-483d-b3aa-4d73b923b5be Jun 29 11:28:02 devstack sudo[114355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:28:02 devstack sudo[114352]: pam_unix(sudo:session): session closed for user root Jun 29 11:28:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8" returned: 0 in 0.787s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:28:02 devstack cinder-volume[93497]: DEBUG cinder.utils [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Path /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8 not found in is_blk_device check {{(pid=93497) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 11:28:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:28:02 devstack sudo[114360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8 Jun 29 11:28:02 devstack sudo[114360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:28:02 devstack sudo[114355]: pam_unix(sudo:session): session closed for user root Jun 29 11:28:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-61022375-845b-4877-80a9-692d5c7c3780 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a54eb74e-231d-483d-b3aa-4d73b923b5be" returned: 0 in 0.777s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:28:02 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-61022375-845b-4877-80a9-692d5c7c3780 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a54eb74e-231d-483d-b3aa-4d73b923b5be {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:28:02 devstack sudo[114365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a54eb74e-231d-483d-b3aa-4d73b923b5be Jun 29 11:28:02 devstack sudo[114365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:28:03 devstack sudo[114365]: pam_unix(sudo:session): session closed for user root Jun 29 11:28:03 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-61022375-845b-4877-80a9-692d5c7c3780 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-a54eb74e-231d-483d-b3aa-4d73b923b5be" returned: 0 in 1.000s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:28:03 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-61022375-845b-4877-80a9-692d5c7c3780 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "cinder-quobyte-a54eb74e-231d-483d-b3aa-4d73b923b5be" released by "delete_volume" :: held 1.842s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:28:03 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-61022375-845b-4877-80a9-692d5c7c3780 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Created reservations ['a4476c39-9562-4f8b-876f-07f867bd2aa7', '324ff44b-c93a-480e-b845-9a9e7ceeb7d1', '7bf36879-b523-425d-9649-594fb0a1f8cd', '339a9009-952a-4248-805c-0dd12566334c'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:28:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-61022375-845b-4877-80a9-692d5c7c3780 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:28:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-61022375-845b-4877-80a9-692d5c7c3780 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:28:04 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-61022375-845b-4877-80a9-692d5c7c3780 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:28:04 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-61022375-845b-4877-80a9-692d5c7c3780 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:28:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-61022375-845b-4877-80a9-692d5c7c3780 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:28:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-61022375-845b-4877-80a9-692d5c7c3780 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:28:04 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a511a151-5bc2-407d-bdae-1a90d5b4f769 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "cinder-2c036968-783b-47d5-9801-e61fef94eae4-delete_snapshot" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:28:04 devstack sudo[114379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:28:04 devstack sudo[114379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:28:04 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a511a151-5bc2-407d-bdae-1a90d5b4f769 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "cinder-2c036968-783b-47d5-9801-e61fef94eae4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:28:04 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a511a151-5bc2-407d-bdae-1a90d5b4f769 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "cinder-quobyte-41ac6780-1a95-4c4a-b389-0018adbb3db4" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:28:04 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a511a151-5bc2-407d-bdae-1a90d5b4f769 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "cinder-quobyte-41ac6780-1a95-4c4a-b389-0018adbb3db4" acquired by "delete_snapshot" :: waited 0.058s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:28:04 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a511a151-5bc2-407d-bdae-1a90d5b4f769 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "cinder-quobyte-2c036968-783b-47d5-9801-e61fef94eae4" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:28:04 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a511a151-5bc2-407d-bdae-1a90d5b4f769 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "cinder-quobyte-2c036968-783b-47d5-9801-e61fef94eae4" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:28:04 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-a511a151-5bc2-407d-bdae-1a90d5b4f769 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Deleting offline snapshot 2c036968-783b-47d5-9801-e61fef94eae4 of volume 41ac6780-1a95-4c4a-b389-0018adbb3db4 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:28:04 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-a511a151-5bc2-407d-bdae-1a90d5b4f769 tempest-CreateVolumesFromSnapshotTest-1253550899 None] snapshot_file for this snap is: volume-41ac6780-1a95-4c4a-b389-0018adbb3db4.2c036968-783b-47d5-9801-e61fef94eae4 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:28:04 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f13f3b-cc7a-49df-a56a-0f8bc5837ad9]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:28:04 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a511a151-5bc2-407d-bdae-1a90d5b4f769 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4.2c036968-783b-47d5-9801-e61fef94eae4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:28:04 devstack sudo[114381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4.2c036968-783b-47d5-9801-e61fef94eae4 Jun 29 11:28:04 devstack sudo[114381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:28:05 devstack sudo[114379]: pam_unix(sudo:session): session closed for user root Jun 29 11:28:05 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-61022375-845b-4877-80a9-692d5c7c3780 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 1.603s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:28:05 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-61022375-845b-4877-80a9-692d5c7c3780 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:28:05 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-61022375-845b-4877-80a9-692d5c7c3780 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Deleted volume successfully. Jun 29 11:28:05 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-61022375-845b-4877-80a9-692d5c7c3780 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "cinder-a54eb74e-231d-483d-b3aa-4d73b923b5be-delete_volume" released by "delete_volume" :: held 4.069s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:28:06 devstack sudo[114381]: pam_unix(sudo:session): session closed for user root Jun 29 11:28:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a511a151-5bc2-407d-bdae-1a90d5b4f769 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4.2c036968-783b-47d5-9801-e61fef94eae4" returned: 0 in 1.816s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:28:06 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-a511a151-5bc2-407d-bdae-1a90d5b4f769 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41ac6780-1a95-4c4a-b389-0018adbb3db4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:28:06 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa95ab1-1c2f-45c9-91bc-0599a9cbf2af]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:28:06 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a511a151-5bc2-407d-bdae-1a90d5b4f769 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:28:06 devstack sudo[114387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4 Jun 29 11:28:06 devstack sudo[114387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:28:07 devstack sudo[114360]: pam_unix(sudo:session): session closed for user root Jun 29 11:28:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8" returned: 0 in 5.141s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:28:07 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6643ee1-e6a3-4e67-831a-5077ca7442c1]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:28:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:28:07 devstack sudo[114389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8 Jun 29 11:28:07 devstack sudo[114389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:28:07 devstack sudo[114387]: pam_unix(sudo:session): session closed for user root Jun 29 11:28:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a511a151-5bc2-407d-bdae-1a90d5b4f769 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4" returned: 0 in 1.220s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:28:07 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a511a151-5bc2-407d-bdae-1a90d5b4f769 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4.2c036968-783b-47d5-9801-e61fef94eae4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:28:07 devstack sudo[114394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4.2c036968-783b-47d5-9801-e61fef94eae4 Jun 29 11:28:07 devstack sudo[114394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:28:08 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:28:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:28:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:28:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:28:08 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:28:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:28:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:28:08 devstack sudo[114397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:28:08 devstack sudo[114397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:28:08 devstack sudo[114394]: pam_unix(sudo:session): session closed for user root Jun 29 11:28:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a511a151-5bc2-407d-bdae-1a90d5b4f769 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4.2c036968-783b-47d5-9801-e61fef94eae4" returned: 0 in 0.733s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:28:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a511a151-5bc2-407d-bdae-1a90d5b4f769 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4.2c036968-783b-47d5-9801-e61fef94eae4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:28:08 devstack sudo[114406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4.2c036968-783b-47d5-9801-e61fef94eae4 Jun 29 11:28:08 devstack sudo[114406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:28:08 devstack sudo[114389]: pam_unix(sudo:session): session closed for user root Jun 29 11:28:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8" returned: 0 in 1.015s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:28:08 devstack cinder-volume[93497]: DEBUG cinder.image.image_utils [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Image conversion details: src /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8, size 1024.00 MB, duration 5.14 sec, destination /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8 {{(pid=93497) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 11:28:08 devstack cinder-volume[93497]: INFO cinder.image.image_utils [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Converted 1024.00 MB image at 199.12 MB/s Jun 29 11:28:08 devstack cinder-volume[93497]: WARNING cinder.volume.drivers.remotefs [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8 is being set with open permissions: ugo+rw Jun 29 11:28:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:28:08 devstack sudo[114408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8 Jun 29 11:28:08 devstack sudo[114408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:28:08 devstack sudo[114397]: pam_unix(sudo:session): session closed for user root Jun 29 11:28:08 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.659s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:28:08 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:28:08 devstack cinder-volume[93497]: DEBUG oslo_service.periodic_task [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] Running periodic task VolumeManager._thread_info {{(pid=93497) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 11:28:08 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread count: 29 {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 11:28:08 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4ee0b372-4a94-46a7-815c-3496b0e68208 None None] thread info: [<_MainThread(MainThread, started 131117520400512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93497) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 11:28:09 devstack sudo[114406]: pam_unix(sudo:session): session closed for user root Jun 29 11:28:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-a511a151-5bc2-407d-bdae-1a90d5b4f769 tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4.2c036968-783b-47d5-9801-e61fef94eae4" returned: 0 in 0.664s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:28:09 devstack sudo[114408]: pam_unix(sudo:session): session closed for user root Jun 29 11:28:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8" returned: 0 in 0.628s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:28:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a511a151-5bc2-407d-bdae-1a90d5b4f769 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "cinder-quobyte-2c036968-783b-47d5-9801-e61fef94eae4" released by "_delete_snapshot" :: held 4.630s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:28:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Lock "cinder-quobyte-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8" released by "_copy_volume_from_snapshot" :: held 8.442s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:28:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a511a151-5bc2-407d-bdae-1a90d5b4f769 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "cinder-quobyte-41ac6780-1a95-4c4a-b389-0018adbb3db4" released by "delete_snapshot" :: held 4.683s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:28:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Lock "cinder-quobyte-ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8" released by "_create_volume_from_snapshot" :: held 8.522s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:28:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.538s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:28:09 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe5baec-ecde-4eb4-99d5-3da2bcd480f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8', 'volume_size': 1, 'snapshot_id': 'ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7'}' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:28:09 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0579e9ff-9110-42f5-9beb-bd87aebee749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 11:28:09 devstack cinder-volume[93497]: INFO cinder.volume.flows.manager.create_volume [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Volume volume-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8 (880ed4a6-a4c0-4d22-a98f-ee8f02487bd8): created successfully Jun 29 11:28:09 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0579e9ff-9110-42f5-9beb-bd87aebee749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93497) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 11:28:09 devstack cinder-volume[93497]: DEBUG cinder.volume.manager [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Flow 'volume_create_manager' (08ca7e37-1650-439a-9ba4-6c257146c3e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93497) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 11:28:09 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-4081651a-a2a3-4417-ac57-1e5c871bd9ef tempest-SnapshotDependencyTests-899269649 None] Created volume successfully. Jun 29 11:28:09 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-a511a151-5bc2-407d-bdae-1a90d5b4f769 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Created reservations ['7b0116ab-419a-43df-8783-0d1bc10cf513', 'e04d17a5-b394-4a92-82da-14e0f7fac36c', '6600da81-aeeb-4841-9929-7378a94df1fb', 'a4ebfe70-fe61-4a6e-8f47-a1e4cc885071'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:28:09 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-a511a151-5bc2-407d-bdae-1a90d5b4f769 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Delete snapshot completed successfully. Jun 29 11:28:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-a511a151-5bc2-407d-bdae-1a90d5b4f769 tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "cinder-2c036968-783b-47d5-9801-e61fef94eae4-delete_snapshot" released by "delete_snapshot" :: held 4.946s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:28:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-23fd644d-c636-42a9-b9e9-e7624f5d09e0 tempest-SnapshotDependencyTests-899269649 None] Acquiring lock "cinder-ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7-delete_snapshot" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:28:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-23fd644d-c636-42a9-b9e9-e7624f5d09e0 tempest-SnapshotDependencyTests-899269649 None] Lock "cinder-ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:28:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-23fd644d-c636-42a9-b9e9-e7624f5d09e0 tempest-SnapshotDependencyTests-899269649 None] Acquiring lock "cinder-quobyte-c3e6d851-1f37-4cd7-a05a-ee87129a77c8" by "delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:28:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-23fd644d-c636-42a9-b9e9-e7624f5d09e0 tempest-SnapshotDependencyTests-899269649 None] Lock "cinder-quobyte-c3e6d851-1f37-4cd7-a05a-ee87129a77c8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:28:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-23fd644d-c636-42a9-b9e9-e7624f5d09e0 tempest-SnapshotDependencyTests-899269649 None] Acquiring lock "cinder-quobyte-ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7" by "_delete_snapshot" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:28:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-23fd644d-c636-42a9-b9e9-e7624f5d09e0 tempest-SnapshotDependencyTests-899269649 None] Lock "cinder-quobyte-ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:28:09 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-23fd644d-c636-42a9-b9e9-e7624f5d09e0 tempest-SnapshotDependencyTests-899269649 None] Deleting offline snapshot ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7 of volume c3e6d851-1f37-4cd7-a05a-ee87129a77c8 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 11:28:09 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-23fd644d-c636-42a9-b9e9-e7624f5d09e0 tempest-SnapshotDependencyTests-899269649 None] snapshot_file for this snap is: volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8.ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7 {{(pid=93497) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 11:28:09 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d949508-e30a-464b-add8-13824647c3e4]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:28:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-23fd644d-c636-42a9-b9e9-e7624f5d09e0 tempest-SnapshotDependencyTests-899269649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8.ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:28:09 devstack sudo[114413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8.ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7 Jun 29 11:28:09 devstack sudo[114413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:28:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-90a72254-1b98-48e3-9fb8-a3c6621c399b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "cinder-41ac6780-1a95-4c4a-b389-0018adbb3db4-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:28:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-90a72254-1b98-48e3-9fb8-a3c6621c399b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "cinder-41ac6780-1a95-4c4a-b389-0018adbb3db4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:28:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-90a72254-1b98-48e3-9fb8-a3c6621c399b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "cinder-quobyte-41ac6780-1a95-4c4a-b389-0018adbb3db4" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:28:09 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-90a72254-1b98-48e3-9fb8-a3c6621c399b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "cinder-quobyte-41ac6780-1a95-4c4a-b389-0018adbb3db4" acquired by "delete_volume" :: waited 0.017s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:28:09 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[732ccdec-2650-4b31-9b38-8fcc08b63fd4]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:28:09 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90a72254-1b98-48e3-9fb8-a3c6621c399b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:28:09 devstack sudo[114415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4 Jun 29 11:28:09 devstack sudo[114415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:28:10 devstack sudo[114413]: pam_unix(sudo:session): session closed for user root Jun 29 11:28:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-23fd644d-c636-42a9-b9e9-e7624f5d09e0 tempest-SnapshotDependencyTests-899269649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8.ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7" returned: 0 in 0.756s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:28:10 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.remotefs [None req-23fd644d-c636-42a9-b9e9-e7624f5d09e0 tempest-SnapshotDependencyTests-899269649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93497) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 11:28:10 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa7c026-7813-4b9f-b12e-b5fe2c1e7cec]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:28:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-23fd644d-c636-42a9-b9e9-e7624f5d09e0 tempest-SnapshotDependencyTests-899269649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:28:10 devstack sudo[114420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8 Jun 29 11:28:10 devstack sudo[114420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:28:10 devstack sudo[114415]: pam_unix(sudo:session): session closed for user root Jun 29 11:28:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90a72254-1b98-48e3-9fb8-a3c6621c399b tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4" returned: 0 in 0.767s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:28:10 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90a72254-1b98-48e3-9fb8-a3c6621c399b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:28:10 devstack sudo[114425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4 Jun 29 11:28:10 devstack sudo[114425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:28:11 devstack sudo[114420]: pam_unix(sudo:session): session closed for user root Jun 29 11:28:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-23fd644d-c636-42a9-b9e9-e7624f5d09e0 tempest-SnapshotDependencyTests-899269649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8" returned: 0 in 0.732s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:28:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-23fd644d-c636-42a9-b9e9-e7624f5d09e0 tempest-SnapshotDependencyTests-899269649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8.ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:28:11 devstack sudo[114430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8.ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7 Jun 29 11:28:11 devstack sudo[114430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:28:11 devstack sudo[114425]: pam_unix(sudo:session): session closed for user root Jun 29 11:28:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90a72254-1b98-48e3-9fb8-a3c6621c399b tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-41ac6780-1a95-4c4a-b389-0018adbb3db4" returned: 0 in 0.653s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:28:11 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-90a72254-1b98-48e3-9fb8-a3c6621c399b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "cinder-quobyte-41ac6780-1a95-4c4a-b389-0018adbb3db4" released by "delete_volume" :: held 1.484s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:28:11 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-90a72254-1b98-48e3-9fb8-a3c6621c399b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Created reservations ['697b13f9-8940-4f4e-8ec8-c74da003708f', 'e3a9cd6b-d565-4d34-8744-117a68dd2068', '3345d864-bc82-4d6e-8455-e6ccd4293afb', '6e82bde8-e865-4b49-adf2-c0fe6ca5dc62'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:28:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-90a72254-1b98-48e3-9fb8-a3c6621c399b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:28:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-90a72254-1b98-48e3-9fb8-a3c6621c399b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:28:11 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-90a72254-1b98-48e3-9fb8-a3c6621c399b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:28:11 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-90a72254-1b98-48e3-9fb8-a3c6621c399b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:28:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-90a72254-1b98-48e3-9fb8-a3c6621c399b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:28:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90a72254-1b98-48e3-9fb8-a3c6621c399b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:28:11 devstack sudo[114433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:28:11 devstack sudo[114433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:28:11 devstack sudo[114430]: pam_unix(sudo:session): session closed for user root Jun 29 11:28:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-23fd644d-c636-42a9-b9e9-e7624f5d09e0 tempest-SnapshotDependencyTests-899269649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8.ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7" returned: 0 in 0.719s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:28:11 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-23fd644d-c636-42a9-b9e9-e7624f5d09e0 tempest-SnapshotDependencyTests-899269649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8.ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:28:11 devstack sudo[114438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8.ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7 Jun 29 11:28:11 devstack sudo[114438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:28:12 devstack sudo[114433]: pam_unix(sudo:session): session closed for user root Jun 29 11:28:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-90a72254-1b98-48e3-9fb8-a3c6621c399b tempest-CreateVolumesFromSnapshotTest-1253550899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.626s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:28:12 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-90a72254-1b98-48e3-9fb8-a3c6621c399b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:28:12 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-90a72254-1b98-48e3-9fb8-a3c6621c399b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Deleted volume successfully. Jun 29 11:28:12 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-90a72254-1b98-48e3-9fb8-a3c6621c399b tempest-CreateVolumesFromSnapshotTest-1253550899 None] Lock "cinder-41ac6780-1a95-4c4a-b389-0018adbb3db4-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:28:12 devstack sudo[114438]: pam_unix(sudo:session): session closed for user root Jun 29 11:28:12 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-23fd644d-c636-42a9-b9e9-e7624f5d09e0 tempest-SnapshotDependencyTests-899269649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8.ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7" returned: 0 in 0.658s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:28:12 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-23fd644d-c636-42a9-b9e9-e7624f5d09e0 tempest-SnapshotDependencyTests-899269649 None] Lock "cinder-quobyte-ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7" released by "_delete_snapshot" :: held 2.975s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:28:12 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-23fd644d-c636-42a9-b9e9-e7624f5d09e0 tempest-SnapshotDependencyTests-899269649 None] Lock "cinder-quobyte-c3e6d851-1f37-4cd7-a05a-ee87129a77c8" released by "delete_snapshot" :: held 3.001s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:28:12 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-23fd644d-c636-42a9-b9e9-e7624f5d09e0 tempest-SnapshotDependencyTests-899269649 None] Created reservations ['e8c7bf4f-e371-4d2b-8fad-a0434ceff376', '65113fd6-be5d-4287-a75e-4608a6850a4b', 'ee646726-f97c-4267-8eed-93600307d475', 'ff8d2478-3911-41d6-bb5c-8af68dd1c289'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:28:12 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-23fd644d-c636-42a9-b9e9-e7624f5d09e0 tempest-SnapshotDependencyTests-899269649 None] Delete snapshot completed successfully. Jun 29 11:28:12 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-23fd644d-c636-42a9-b9e9-e7624f5d09e0 tempest-SnapshotDependencyTests-899269649 None] Lock "cinder-ff7393fd-bc93-4d56-a9c7-2010ccc5bfd7-delete_snapshot" released by "delete_snapshot" :: held 3.169s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:28:13 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4334fd05-905c-4a60-86a2-ba436dcf97de tempest-SnapshotDependencyTests-899269649 None] Acquiring lock "cinder-c3e6d851-1f37-4cd7-a05a-ee87129a77c8-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:28:13 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4334fd05-905c-4a60-86a2-ba436dcf97de tempest-SnapshotDependencyTests-899269649 None] Lock "cinder-c3e6d851-1f37-4cd7-a05a-ee87129a77c8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:28:13 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4334fd05-905c-4a60-86a2-ba436dcf97de tempest-SnapshotDependencyTests-899269649 None] Acquiring lock "cinder-quobyte-c3e6d851-1f37-4cd7-a05a-ee87129a77c8" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:28:13 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4334fd05-905c-4a60-86a2-ba436dcf97de tempest-SnapshotDependencyTests-899269649 None] Lock "cinder-quobyte-c3e6d851-1f37-4cd7-a05a-ee87129a77c8" acquired by "delete_volume" :: waited 0.016s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:28:13 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ca8f9d-0bc6-49e3-aff8-3f016ebf6169]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:28:13 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4334fd05-905c-4a60-86a2-ba436dcf97de tempest-SnapshotDependencyTests-899269649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:28:13 devstack sudo[114443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8 Jun 29 11:28:13 devstack sudo[114443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:28:14 devstack sudo[114443]: pam_unix(sudo:session): session closed for user root Jun 29 11:28:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4334fd05-905c-4a60-86a2-ba436dcf97de tempest-SnapshotDependencyTests-899269649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8" returned: 0 in 0.754s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:28:14 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4334fd05-905c-4a60-86a2-ba436dcf97de tempest-SnapshotDependencyTests-899269649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:28:14 devstack sudo[114448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8 Jun 29 11:28:14 devstack sudo[114448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:28:15 devstack sudo[114448]: pam_unix(sudo:session): session closed for user root Jun 29 11:28:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4334fd05-905c-4a60-86a2-ba436dcf97de tempest-SnapshotDependencyTests-899269649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-c3e6d851-1f37-4cd7-a05a-ee87129a77c8" returned: 0 in 0.651s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:28:15 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4334fd05-905c-4a60-86a2-ba436dcf97de tempest-SnapshotDependencyTests-899269649 None] Lock "cinder-quobyte-c3e6d851-1f37-4cd7-a05a-ee87129a77c8" released by "delete_volume" :: held 1.459s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:28:15 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-4334fd05-905c-4a60-86a2-ba436dcf97de tempest-SnapshotDependencyTests-899269649 None] Created reservations ['6a589332-1566-4251-b1f2-17fb0d57130d', '29b0efbb-768e-4b42-8222-ef8e3b1872af', 'b0eab3fa-649e-423d-9e1d-51ccf9eee212', '07abd376-429b-4a12-8f31-861b43eb2b6e'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:28:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4334fd05-905c-4a60-86a2-ba436dcf97de tempest-SnapshotDependencyTests-899269649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:28:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4334fd05-905c-4a60-86a2-ba436dcf97de tempest-SnapshotDependencyTests-899269649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:28:15 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4334fd05-905c-4a60-86a2-ba436dcf97de tempest-SnapshotDependencyTests-899269649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:28:15 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-4334fd05-905c-4a60-86a2-ba436dcf97de tempest-SnapshotDependencyTests-899269649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:28:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-4334fd05-905c-4a60-86a2-ba436dcf97de tempest-SnapshotDependencyTests-899269649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:28:15 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4334fd05-905c-4a60-86a2-ba436dcf97de tempest-SnapshotDependencyTests-899269649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:28:15 devstack sudo[114451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:28:15 devstack sudo[114451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:28:15 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-5fe8130d-b448-481d-a2c1-afa8b5b05b2b tempest-SnapshotDependencyTests-899269649 None] Acquiring lock "cinder-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8-delete_volume" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:28:15 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-5fe8130d-b448-481d-a2c1-afa8b5b05b2b tempest-SnapshotDependencyTests-899269649 None] Lock "cinder-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:28:16 devstack sudo[114451]: pam_unix(sudo:session): session closed for user root Jun 29 11:28:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-4334fd05-905c-4a60-86a2-ba436dcf97de tempest-SnapshotDependencyTests-899269649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.656s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:28:16 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-4334fd05-905c-4a60-86a2-ba436dcf97de tempest-SnapshotDependencyTests-899269649 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:28:16 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-5fe8130d-b448-481d-a2c1-afa8b5b05b2b tempest-SnapshotDependencyTests-899269649 None] Acquiring lock "cinder-quobyte-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8" by "delete_volume" {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 11:28:16 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-4334fd05-905c-4a60-86a2-ba436dcf97de tempest-SnapshotDependencyTests-899269649 None] Deleted volume successfully. Jun 29 11:28:16 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-5fe8130d-b448-481d-a2c1-afa8b5b05b2b tempest-SnapshotDependencyTests-899269649 None] Lock "cinder-quobyte-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8" acquired by "delete_volume" :: waited 0.022s {{(pid=93497) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 11:28:16 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-4334fd05-905c-4a60-86a2-ba436dcf97de tempest-SnapshotDependencyTests-899269649 None] Lock "cinder-c3e6d851-1f37-4cd7-a05a-ee87129a77c8-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:28:16 devstack cinder-volume[93497]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c58a67-c272-453a-b27f-37de055bfa7e]: (4, 'qcow2') {{(pid=94221) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 11:28:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fe8130d-b448-481d-a2c1-afa8b5b05b2b tempest-SnapshotDependencyTests-899269649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:28:16 devstack sudo[114454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8 Jun 29 11:28:16 devstack sudo[114454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:28:16 devstack sudo[114454]: pam_unix(sudo:session): session closed for user root Jun 29 11:28:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fe8130d-b448-481d-a2c1-afa8b5b05b2b tempest-SnapshotDependencyTests-899269649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8" returned: 0 in 0.777s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:28:16 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fe8130d-b448-481d-a2c1-afa8b5b05b2b tempest-SnapshotDependencyTests-899269649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:28:16 devstack sudo[114459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8 Jun 29 11:28:16 devstack sudo[114459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:28:17 devstack sudo[114459]: pam_unix(sudo:session): session closed for user root Jun 29 11:28:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fe8130d-b448-481d-a2c1-afa8b5b05b2b tempest-SnapshotDependencyTests-899269649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90/volume-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8" returned: 0 in 0.645s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:28:17 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-5fe8130d-b448-481d-a2c1-afa8b5b05b2b tempest-SnapshotDependencyTests-899269649 None] Lock "cinder-quobyte-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8" released by "delete_volume" :: held 1.466s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:28:17 devstack cinder-volume[93497]: DEBUG cinder.quota [None req-5fe8130d-b448-481d-a2c1-afa8b5b05b2b tempest-SnapshotDependencyTests-899269649 None] Created reservations ['893f1a71-4341-44fe-96c0-6fb46c50662f', 'fcb4c353-647a-424f-9491-7b1e915cf6dd', '80ec4ffb-a774-454c-a648-b5351deb8d66', '78bf2bbb-9ddd-45a9-9419-7fe327b656ec'] {{(pid=93497) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 11:28:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5fe8130d-b448-481d-a2c1-afa8b5b05b2b tempest-SnapshotDependencyTests-899269649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 11:28:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5fe8130d-b448-481d-a2c1-afa8b5b05b2b tempest-SnapshotDependencyTests-899269649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 11:28:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5fe8130d-b448-481d-a2c1-afa8b5b05b2b tempest-SnapshotDependencyTests-899269649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3': None} {{(pid=93497) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 11:28:17 devstack cinder-volume[93497]: DEBUG cinder.volume.drivers.quobyte [None req-5fe8130d-b448-481d-a2c1-afa8b5b05b2b tempest-SnapshotDependencyTests-899269649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3d4c00e1-e689-4e03-96ab-f117a17349a3'] {{(pid=93497) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 11:28:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.lockutils [None req-5fe8130d-b448-481d-a2c1-afa8b5b05b2b tempest-SnapshotDependencyTests-899269649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93497) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 11:28:17 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fe8130d-b448-481d-a2c1-afa8b5b05b2b tempest-SnapshotDependencyTests-899269649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 11:28:17 devstack sudo[114462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90 Jun 29 11:28:17 devstack sudo[114462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 11:28:18 devstack sudo[114462]: pam_unix(sudo:session): session closed for user root Jun 29 11:28:18 devstack cinder-volume[93497]: DEBUG oslo_concurrency.processutils [None req-5fe8130d-b448-481d-a2c1-afa8b5b05b2b tempest-SnapshotDependencyTests-899269649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b138fdc0efee44b062cd227379d54d90" returned: 0 in 0.689s {{(pid=93497) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 11:28:18 devstack cinder-volume[93497]: DEBUG cinder.manager [None req-5fe8130d-b448-481d-a2c1-afa8b5b05b2b tempest-SnapshotDependencyTests-899269649 None] Notifying Schedulers of capabilities ... {{(pid=93497) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 11:28:18 devstack cinder-volume[93497]: INFO cinder.volume.manager [None req-5fe8130d-b448-481d-a2c1-afa8b5b05b2b tempest-SnapshotDependencyTests-899269649 None] Deleted volume successfully. Jun 29 11:28:18 devstack cinder-volume[93497]: DEBUG cinder.coordination [None req-5fe8130d-b448-481d-a2c1-afa8b5b05b2b tempest-SnapshotDependencyTests-899269649 None] Lock "cinder-880ed4a6-a4c0-4d22-a98f-ee8f02487bd8-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=93497) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 11:28:27 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=112,cinder:INSERT=38,cinder:UPDATE=135,cinder:DELETE=12 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 11:28:28 devstack cinder-volume[93497]: DEBUG dbcounter [-] [93497] Writing DB stats cinder:SELECT=106,cinder:UPDATE=157,cinder:DELETE=12,cinder:INSERT=36 {{(pid=93497) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}